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SUMMARY 

AND 

CONCLUSIONS 


THE  I®SEARCH  PROBLEM 

Research  was  performed  to  determine  the  effects  on  proficiency  develop- 
ment of  using  devices  of  loss-tlian-pcrfect  fidelity  for  training  a lengthy 
fixed  procedure.  Tlie  fidelity  of  a training  device  was  the  degree  to  which 
it  resembled  that  tactical  equipment  for  which  the  training  device  was  sub- 
stituted. The  fidelity  of  ti’aining  devices  was  lowered  in  either  appearance 
or  functional  q-uality.  A fixed  procedure  was  a part  of  a job  in  which  all 
signals  to  the  incumbent  and  actions  by  the  inc\mibent  were  specified  in  an 
invariable  sequence. 


j;  PROCEDURE 

( 

The  Task.  A 92-step  procedure  was  used  as  an  example  of  a fixed- 

i 

' procedure  task  during  this  research.  This  procedure  concerned  the  operation 

i 

of  the  Section  Control  Indicator  (SCl)  console  of  the  Nike  Hercules  guided 
missile  system  when  missiles  are  being  prepared  for  firing  (Blue  Status)  and 
being  fired  (Red  Status). 

Training  Devices.  Twelve  different  training  devices  were  used  in  a 
series  of  studies.  A brief  description  of  each  device  has  been  presented 
below. 


The  Hot  Panel.  This  device  was  the  same  size  and  shape  as  the 
tactical  SCI.  Every  light,  switch,  meter,  intercom,  and  tele- 
phone on  this  device  liinctloned.  (See  Figure  2,  p.  13«) 

iii 


I 

1 

1 

) 

I 


i 

I 


j 

i 


1 


j 

I 


1 


'Jlie  Cold  Panel.  On  tMs  device,  every  part  wao  identical  with  the 


corresponding  part  on  the  hot  panel.  Hov/ever,  there  was  no  electri- 
cal power  to  the  device.  'Pliererore,  no  lights,  meters,  intercom, 
or  telephone  functioned.  All  switches  still  could  be  operated. 

(See  Figure  j,  p.  IT.) 

The  Frozen  Panel.  Every  part  on  the  frozen  panel  was  identical 
in  app>eai-ance  wlt}i  the  cori'esponding  part  on  the  hot  panel,  but 
no  part  was  operable.  All  switches  were  immovably  fixed  in  OFF 
position.  (See  Figirre  4,  p.  IT.) 

Tlie  Cardboard  Panel.  The  entire  device  was  fabricated  of  card- 
board, including  the  housing.  The  panel  was  painted  in  color  to 
resemble  the  hot  panel  above.  The  remainder  was  painted  the  same 
gray  color  as  that  of  the  other  device  housings.  (See  Figure  11, 
p.  30.) 

Tlie  Photographic  Panel.  This  device  was  a full-sized  black-and- 
white  photographic  print  of  the  hot  panel  above,  installed  in  a 
high  fidelity  housing.  (See  Figure  5,  p.  21.) 

The  Drawing  Panel.  This  device  was  a full-sized  black-and-white 
line  drawing  of  the  hot  panel,  installed  in  a high  fidelity 
housing.  (See  Figure  6,  p,  21.) 

The  Hi-Fi  Housing.  This  device  was  a replica  of  the  housing  of  the 
hot  panel.  The  cold  panel  was  installed  dtiring  the  housing  study. 
(See  Figure  J,  p.  25.) 
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The  Box  IkiUPlne.  This  device  was  a box  made  of  plywood.  It  was  ol 
appropriate  size  and  shape  to  hold  the  cold  panel,  which  was  in- 
stalled for  the  study  of  housing  effects.  (Cee  Figure  8,  p.  25.) 

Tl-je  Frame  Housing.  Tills  device  was  a simple  v/ooden  frame  of  ap- 
pi'opriatc  size  to  hold  and  support  the  cold  panel.  (Gee  Figvire  9, 
p.  25.) 

Tile  iMLl-Slzed  Panel.  This  device  was  another  line  drawing  on 
which  the  lettering  was  Increased  in  size.  The  panel  was  22"  x 30”. 
( See  Fi  gure  12 , p . 3^  • ) 

Tlie  Half -Sized  Panel.  This  device  was  a 15"  x 22"  reproduction  of 
the  full-sized  panel  above  and  was  one -half  the  area  of  the  full- 
sized  panel.  (See  Figure  12,  p.  3^*) 

The  Small  Panel.  This  device  was  a 5"  x 7"  reproduction  of  the 
full-sized  panel  and  was  one -nineteenth  the  area  of  the  full-sized 
panel.  (See  Figure  12,  p.  3^-) 

RESULTS 

Five-man  groups  were  trained  with  each  of  the  above  training  devices 
until  15  or  20  men  had  been  trained  with  each  device.  Each  trainee  was 
administered  a proficiency  test  and  a record  was  kept  of  the  total  train- 
ing time  used  for  each  trainee.  The  resulting  proficiency  scores  and 
; training  times  were  submitted  to  statistical  analysis.  Small  differences 

in  average  (mean)  proficiency  scores  and  average  training  times  were  found 

I 

^ among  the  several  devices.  These  are  illustrated  in  the  two  charts  below. 
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TRAINING  DEVICE 


Frozen  Panel 


Pliotographic  Panel 


Drawing  Panel 


Hi-Fi  Housing 


Hox  Housing 


Fi'ame  ]Iousing 


P’ull-Size  Panel 


Small  Panel 


Mean  Proficiency  Score 

Comparison  of  Average  Proficiency  Level  Produced  with 
Twelve  Training  Devices  , 


TRAINING  DEVICE 


Cold  Panel 


Cardboard  Panel 


Photographic  Panel 


Drawing  Panel 


Hi-Fi  Housing 


Box  Housing 
Frame  Housing 


Average  Training  Time  (Hours) 

Figxiro  B.  Comparison  of  Average  Time  Required  to  Train 
with  Each  of  Nine  Training  Devices 


The  statistical  analyses  showed  that,  while  there  were  small  differences 


in  average  proficiency  and  average  training  time  for  each  device,  none  of 
these  differences  is  largc'i'  than  chance  would  allow. 

A Field  test  of  tlic  above  findings  was  perfonned  in  which  military  in- 
structors trained  soldiers  to  perfonn  this  task  as  part  of  Advanced  Indivi- 


dual Training  foi’  iiilitaiy  Occupational  Specialty  (MOS  ITT)-  Some  instruc- 


tors used  the  actual  live  equipment  dux-ing  this  training  while  other  instruc- 
toi’s  used  the  full-sise  line  drawing  of  the  panel.  Proficiency  scores  and 
training  times  were  collected  and  analyzed  statistically.  Only  chance  dif- 
ferences were  found  betv/een  the  terminal  average  proficiency  scores  or 
training  times  of  the  men  trained  under  both  conditions.  The  results  of 
other  research  were  compared  to  the  above  findings  and  largely  tend  to 
confinn  them. 

CONCLUSIOIIS 


1.  Wlien  men  are  being  trained  to  perform  a fixed  procedure,  the  re- 
quirements for  functional  fidelity  in  the  training  device  are  qxiite  low. 

A line  drawing  of  the  man-machine  interface  will  train  men  as  effectively 
in  this  circumstance  as  will  a device  of  higher  fidelity. 

2.  No  effect  on  proficiency  development  is  likely  to  occur  due  to 
reducing  housing  fidelity  of  the  man-machine  interface  on  a training  de- 
vice. The  least  expensive  housing  which  will  adequately  support  and 
protect  the  man-machine  interface  should  be  used. 
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..  c*"’.iii.Lu  pro,  rail  uses  various  net.iods  of  traiaiiir  so  tdat  men  | 

I 

:'ll  t .e  ti’ainin  • o. .leotives.  Use  of  a training:  device  is  one  i 

.■.e-  .o^.  of  crai..ii:, . ..cu,  a,  I it  is  especially  usex'ul  w.ier.  traiaccs  I'luSu  ! 

learn  and  practice  actions.  The  desi.jner  of  training  pro;;raL'.s  is  faced  i 

•u'it  . a question  of  wnetner  to  use  a trainin{T  device  or  soiie  otiier  inct.-od  i 

of  trai'iin,".  .-Oiie  yuidance  toward  ai'  answer  to  this  question  can  be  i 

ol’tained  frou  Oarne  (l9i'.-);  Hiller  ( 195^0  > Denaree  (l9ol),  Parker  ajid  ' 

Uovnis  (l;)ol),  and  '/illis  and  Peterson  (l^^il).  ‘.raen  a trainin'.'  pro.srai'n  ; 

! 

desi'-ner  :as  decided  to  use  a training  device,  j^e  is  faced  with  othei'  \ 

j 

q-uesti’ons  corieerninf  t..e  'becunical  characteristics  of  such  devices.  ; 

1 

1 

Task  hlITGaR  nas  the  obfiective  of  deteiTiinin,e  tl.e  fidelity  require-  j 

:ents  of  trai'iiin^;  devices  for  fixed  procedures  tasl:s.  Tne  fidelity  of  ] 


a trainin  ' device  is  tae  dejree  to  which  it  reseiables  taat  tactical 
eq-.iip;  ent  .’or  waicn  the  trainin, q device  is  substituted.  A fixed  pro- 
cediu’e  task  is  a part  of  a Job  in  which  all  signals  to  tne  incutibent 
£.nd  actions  by  the  incurfoent  are  specified  in  an  invariable  sequence. 


■foncernlny  fidelity. 

for  Many  j'ears,  transfer  of  trainino  studies  na've  snowii  taat  the 
r.;ox’e  aline  two  situations  are,  tiie  more  taat  trainino  in  one  situation 
will  produce  proper  perforiiiance  in  the  second  situation.  Bugelski 


f 


notes  tuat,  " . . .exj-Xirlinental  liudincs  indicate  tuat  positive  transfer  is 
a function  of  tiie  decree  of  sii.iilarity  between  stiii.uli  (if  responses  are 
tue  soi.ie),  and  iierative  transfer  is  a function  of  tlie  decree  of  dif- 
ference betv/een  responses  if  tne  stimuli  are  ti.e  same"  (iy5o,  p.  40-/), 

Tue  onvious  coLiclusion  is,  "for  maximum  transfer  of  traininfr,  use  de- 
vices of  perfect  fidelity."  However,  more  recently,  tue  older  research 
findiiu  s uavo  come  to  be  suspected  and  devices  uaviu(_;  less-than-perfcct 
fidelity  liave  been  found  to  produce  tue  maximum  transfer  (Muckier,  et  al. 

PP-  Il>>-I3f).  Concern  iias  also  been  expressed  over  the  costs 
associated  wit./  uijpi  fidelity  simulation  (Miller,  19^^;  Muckier,  et  al. , 
l.'^  'j  I’arlior  ■ bowns,  19  ■!).  Thus,  if  it  can  be  determined  t.iat  lowcr- 
tuau-porfect  fidelity  devices  can  be  used  for  training  with  no  more 
tiion  minor  loss  in  proficiency  development,  and  with  no  more  than  minor 
increases  in  training  time,  practical  reductions  in  costs  of  training 
devices  may  be  realized. 

Dimensions  of  fidelity. 

Tue  definition  of  fidelity  of  simulation  has  eluded  the  human 
factors  scientist  for  some  time  (Muckier,  et^  ^. , 1959^  P»  103)*  Thus 
a definition  of  fidelity  is  needed  along  with  some  scheme  for  measuring  ^ 

degi'ecs  of  fidelity.  Tne  present  work  is  based  on  a concept  in  which 
fidelity  is  recognized  as  having  several  dimensions.  One  group  of 
these  dimensions  is  referred  to  as  appearance  fidelity.  Under  appearance 
fidelity  are  such  dimensions  as  color,  size,  shape,  arrangement  of 

j 

parts,  and  tiie  appearance  of  the  container  or  housing  of  the  man-machine  j 

interface.  j 

) 
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ilOMever,  v.icn  i\pi>eara\ice  is  constant,  training  devices  can  still 


be  dirforentiuted  from  one  anotlier  on  the  basis  of  functionality.  That 
is,  a knob  or  ineter  on  one  device  nay  look  exactly  tiie  same  as  that  on 
another  device,  Tnit  on  tiie  first  device  the  knob  will  move  when  turned, 
vniile  on  tne  otiiCr  device  tie  knob  is  fjxed  or  frozen  in  one  position. 

T le  present  repoid;  is  concerned  v;itii  functional  characteristics 
and  t .G  appearance  cate  gories  of  size  and  housing. 

Only  i.:ross  catej  orical  measurement  of  functional  fidelity,  size 
iidelity,  and  nousiac?  fidelity  liave  been  attained.  No  attempt  has  been 
i.;ade  to  deteiriine  tne  psycnoloGical  decrees  of  these  measurements. 

Research  Plan 

Tiie  basic  plan  of  each  study  in  this  report  has  six  steps  or 
factors.  First,  a task  v^as  chosen  as  a vehicle  for  the  study.  The 
tasl.  was  considered  to  be  i’epresentative  of  procedural  tasks  in  general, 

Gecond,  training  devices  were  constructed  which  varied  from  one  anotner 
on  t.iC  particular  dimension  of  fidelity  being  studied.  The  third  step 
was  to  train  groups  of  men  ^;ith  the  several  training  devices.  The 
fourth  factor  dealt  with  experimental  controls.  Control  was  applied 
CO  instructor  effects,  intelligence  level  of  trainees,  methods  used  in 
training  (oth-er  tiian  training  device),  and  level  of  trainee  experience 
witn  respect  to  tr.e  task.  The  fifth  step  was  to  measure  trainee  pro- 
ficiency. The  sixt.i  and  final  step  was  to  test  the  data  for  differences 
in  proL’iciency  which  were  associated  with  the  training  devices  located 
at  difi’erent  ^joints  on  tiie  particular  fidelity  dimension.  Since  each 
of  tne  separate  studies  nad  much  of  the  above  material  in  common,  tne 
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GOiX'.ou  factors  -:ave  been  described  belov:  and  siiould  be  understood  to 
apply  to  eac.i  of  t ie  studies  without  further  description. 

The  procedural  task. 

>iS  definea  for  taese  studies,  a procedural  task  is  work  in  which 
every  action  taken  by  tue  Job  incumbent  is  specified,  in  sequence,  and 
in  -i.’aic.i  tne  actions  to  be  taken  are  so  simple,  or  so  well  known,  that 
any  trainee  for  tiie  .job  will  either  know  now  to  perform  the  action  be- 
fore he  is  trained  or  can  learn  to  perform  the  action  in  one  trial, 
bote  taat  accordiutj  to  this  definition,  tlie  pertinent  demands  for  learn- 
iricc  placed  on  the  trainee  are  that  he  learn  the  sequence  in  which  the 
actions  are  tai:en  and  ncuaes  and/or  locations  of  events  in  the  sequence, 
lie  must  learn  to  talce  each  action  in  its  turn  and  to  avoid  taking  any 
action  out  of  sequence. 

Tne  task  used  for  this  research  was  one  whicn  fulfilled  the 
definition  of  a procedure,  ’..'eis  long  enougli  to  present  a challenge  to 
any  trainee,  yet  short  enougli  to  be  economical  during  data  collection, 
and  geograpiiically  convenient  to  the  investigators.  The  task  was 
selected  from  those  performed  by  Military  Occupational  Specialty  (MOS) 
17V,  Air  Defense  Missile  Crewman,  Nike  Hercules.  Tne  task  consisted 
of  tile  actions  tal^en  by  the  Section  Control  Indicator  (SCl)  operator 
during  Blue  and  Red  Status  when  the  system  operates  in  the  automatic 
node.  During  Blue  Status,  missiles  are  prepared  for  firing.  During 
Red  Status,  missiles  are  fired.  During  this  procedure  106  actions  are 
taken.  The  category  and  frequency  of  the  actions  are  given  below: 
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Operate  a button  switch  (lO) 

Operate  a toCL;ln  switcii  (36) 

Operate  a rotary  switch  (2) 

Operate  a meostab  control  (2) 

Operate  a banana  pluy  (l) 

.rite  t.ie  tinie  (3) 

Give  a verbal  response  on  phone  or  interconi  (ll) 

I'onitor  a liynt  (22) 

I'ionitor  a sound,  oral,  or  uaciiine  originated  (19) 

Ilonitor  a iieter  (2) 

In  eac.i  step  tne  operator  iias  a signal  given  to  aim  and  must  take  a 
specific  action  as  a result  of  the  signal.  Gometiraes  the  signal  for 
an  action  is  simply  t/.e  completion  of  tne  previous  action,  and  some- 
times tiie  action  to  be  taken  is  to  monitor  for  tiie  next  signal.  But 
psychologically  eacn  such  unit,  signal  and  action,  is  a complete  step 
in  tuis  procedure.  Tiie  complete  procedure  is  given  in  Appendix  A.  A 
picture  of  tiie  tactical  SCI  is  presented  in  Figure  1. 

Training  procedure. 

Men  were  trained  in  five-raan  groups.  The  group  reported  for 
training  at  approximately  0730  hours.  Tlie  instructor  introduced  him- 
self, directed  the  trainees  to  be  seated,  and  identified  each  trainee. 
Tiien  the  instructor  informed  the  trainees  that  he  would  instruct  them 
in  tiie  operation  of  a piece  of  Nike  Hercules  equipment  and  identified 
t..e  SCI.  y'vt  tnis  point  the  instructor  displayed  a diagram  of  a Hike 
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Figure  1.  Tactical  SCI 


I'ercules  site  and  identified  each  major  piece  of  equipment,  (;ivinc  a 
brier  description  of  its  function,  ('’ee  Appendix  Tl  for  tae  dia[rrar,i 
and  orientation.)  The  insti’uctor  requested  questions  from  tiie  trainees 
at  this  point.  Very  few  questions  \rere  asl:ed,  and  all  questions  were 
aiiswered  as  directly  as  possible. 

I’ollowinj  any  questions  and  answers,  tiie  instructor  moved  to  tae 
training  device  and  presented  a demonstration  talk-tarouoa  of  the  92- 
step  procedure,  'ie  demciistrated  and  h^'seribed  the  signal  for  an  action 
and  tile  action  itself,  ae  gave  an  explanation  of  why  tlie  action  was 
taken.  Taese  explanations  were  very  simple.  For  example,  the  first 
signal  v/as  the  simultaneous  illumination  of  a Blue  Status  light  and 
sounding  of  an  alarm  bunzer.  Tiie  proper  action  was  to  turn  the  Pov/er 
swifcc.i  to  OH  position.  Tiie  explanation  of  why  this  action  was  taiten 
was,  "You  turn  the  Po\/er  switch  ON  so  that  you  will  have  power  to  this 
panel."  The  demonstration  and  talk -through  included  all  of  tiie  92 
steps. 

’Tnen  this  demonstration  was  completed,  the  instructor  selected  a 
trainee  and  required  that  he  attempt  to  perform  the  complete  procedure. 
Tiie  Instructor  told  the  other  four  trainees  to  watch  carefully  and  to 
be  prepared  to  identify  the  correct  action  if  the  performing  trainee 
made  an  error.  For  the  majority  of  tlie  errors,  the  instructor  would 
request  identification  of  the  correct  action  from  an  observing  trainee, 
'.'iicn  the  correct  action  was  specified  the  instructor  required  the  per- 
foraer  to  make  this  action  and  the  procedure  was  continued  until  the 
92nd  step  was  taken. 
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./l'.en  tiie  first  trainee  iiad  finished  tiie  pi-ocedure,  a second 
trainee  was  selected  to  perfonn  on  the  training;  device,  and  tiie  first 
trainee  became  an  observer.  This  process  was  continued  until  each 
trainee  liad  served  as  a performer  tvrice  and  as  an  observer  eicht 
times.  Training  was  completed  at  approximately  IO3O  hours  the  same 
norning. 

During  this  training  the  instructor  reinforced  correct  actions  by 
suca  ','erbal  expressions  as  "Good,"  and  "That's  riglat."  Not  every  cor- 
rect action  was  reinforced,  and  no  attempt  was  made  to  follow  an  exact 
sciiedule  of  reinforcement.  However,  reinforcement  was  used  more 
frequently  in  tlie  early  stages  of  training  than  it  was  in  the  later 
stages.  Many  tines  this  reinforcement  was  also  knowledge  of  results 
for  the  trainee. 

The  instructors  also  used  cueing  as  a training  technique.  When 
a perfoming  trainee  would  hesitate  to  talce  some  specific  action  after  | 

he  iiad  apparently  recognized  the  signal,  the  instructor  would  attempt  j 

to  give  a cue  (or  clue)  to  the  correct  action.  As  an  example  of  a cue, 
consider  the  following  conditions.  The  seventh  action  is,  "Plug  the  i 

Headset -Handset  into  Station  2."  Tiie  seventh  action's  completion  is  ' 

the  signal  for  the  eiglith  action  to  be  taken;  the  operator  should  an-  I 

nounce  on  the  Headset -Handset,  "Blue  Status  received.  Section  A." 

Wiien  a trainee  had  completed  action  seven  and  hesitated  too  long  to 
make  his  announcement  the  instructor  might  say,  "You  plugged  it  in, 

I 

now  use  it."  Cueing  was  used  much  more  often  in  the  early  part  of 
training  tlian  it  was  in  the  later  part.  No  exact  schedule  of  cueing 
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was  attempted,  ’lather,  eac.i  instructor  tried  to  estimate  tjie  proper 
time  for  a cue  and  an  appropriate  cue  to  use. 

Tne  tactical  SCI  automatically  furnishes  knowledoe  of  results  (Kh) 
to  an  operator  after  many  of  his  actions.  Tiius,  when  the  operator 
presses  tne  Prepared  button  for  launcher  ntmiber  1,  tlie  red  Prepared 
licut  ;_oes  out,  and  tiie  coreen  Prepared  light  illuminates.  One  of  tne 
training  devices  produces  the  some  I®  for  trainees  as  does  the  tacti- 
cal SCI.  Eut  the  otlier  devices  do  not  always  do  so.  Therefore,  the 
instructor  would  present  the  performing  trainee  with  these  on  a 
verbal  basis.  In  the  above  instance,  when  a trainee  pressed  the 
Prepared  button  tiie  instructor  would  say,  "Now  this  red  ligiit  is  off, 
and  tills  green  light  is  on,"  while  he  pointed  to  the  proper  liglits. 

Just  as  the  instructor  was  required  to  give  verbal  KI!  to  trainees 
when  the  training  device  did  not  do  so,  tne  trainees  were  required  to 
produce  a verbal  action  in  place  of  a physical  one  at  times.  Thus, 
the  trainee  was  required  to  monitor  for  a green  Missile  Ready -to-Pire - 
lignt  as  the  action  for  step  u2.  During  the  training  process,  when  a 
device  would  not  illuminate  the  Missile  Ready -to-Fire-lights,  trainees 
were  I’equired  to  tell  the  instructor,  "Now  I am  imiting  for  the  Missile 
Ready -to-Fire-ligiit  for  launciier  1 to  come  on,"  or  make  some  similar 
statement  that  informed  tlie  instructor  that  lie  was  talcing  the  proper 
action  (monitoring). 

Training  time  varied  from  training  group  to  training  group.  Tlie 
experiences  that  eacn  group  underwent  irere  controlled,  but  the  total 
amount  of  time  spent  in  the  training  situation  v«is  alloived  to  vary. 
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AO  no  time  was  t.ie  trainee  viade  to  feel  tnat  ne  was  rusned.  One  rest 
breal;  v;as  .'iven  approxioiately  naif  way  tiiroa^-i  tne  traininc;'  titie  period. 
Otnerwise  t^e  trainin:;  was  continuous. 

All  training  was  conducted  in  a roo;n  approximately  ten  feet  wide 
and  fifteen  feet  lony.  Ot-ier  activities  were  (Oincf  on  insiae  tne 
building;,  nut  not  in  tne  su-ie  roon.  Tne  room  v/as  iieated  witii  a qc.s 
neater  durinc:  cool  weatner  and  cooled  witij  an  evaporative  cooler  in 
not  v/eat  *er. 

Trainees. 

Since  tne  task  selected  for  tnis  researcl^  was  from  LOS  Hi,  uen 
receiving  training  in  tnis  LOS  could  not  be  used  as  ti'ainees,  Tney 
would  nave  varyiiif;  amounts  of  inforiiiation  about  tne  task.  Tnerefore, 
men  were  used  vaio  were  receiviuL'  traininc  in  LOS  192>  Air  Defense  ra-- 
tillery  ^*utoi.iatic  weapons  Crewman.  Tnis  decision  presented  tiie  problem 
of  selectinc  MOG  192  trainees  wiio  were  of  a comparable  talent  level 
to  men  in  MOS  177  trainina.  To  resolve  this  problem,  the  f;eneral 
Technical  (GT)  scores  of  all  men  in  trainin{;:  for  KOS  1 1 ( were  ob- 
tained from  personnel  records,  and  a distribution  of  tnese  scores 
was  r.iade  (sea  Appendix  Table  C-l).  Tnen,  groups  of  trainees  for  MOS 
192  were  selected  sucn  tnat  t.ie  GT  scores  of  eac-  group  matciied  the 
GT  score  distribution  of  the  MOS  IV'i  sample. 

Tne  GT  score  was  chosen  for  tiie  above  selection  factor  because, 
of  tne  fanny  aptitude  area  scores,  this  score  is  the  most  like  a meas- 
ure of  general  intelligence  (llelme,  I90O).  Selection  on  only  one 
aptitude  variable  was  considered  useful  because  the  positive  correlations 
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tj’.out-  tlie  soverr.l  aptitude  scores  produces  dimiiiiSi:in2  reti.irns  as 


control  vitii  additional  variables  is  applied.  Since  only  one  variable 
vas  to  b.e  used  i’or  tiie  i.iatcainy  process,  a i.ieasure  of  general  intellect 
seemed  to  be  tlie  most  meanintjiUl  one  to  use. 

:xperii.iental  and  statistical  controls. 

Statistical  control  vas  applied  to  tjie  intellectual  level  of  tne 
trainees.  7irst,  eaca  fcroup  of  men  trained  w.th  any  device  was  selected 
to  mated  a particular  distribution  of  GT  scores  (see  Appendix  Table  S-l). 
Tnis  procedure  was  described  in  tiie  preceding  section.  Then  tne  variance 
associated  with  GT  scores  was  removed  from  proficiency  scores  by  statis- 
tical methods. 

Differences  araong  proficiency  scores  due  to  different  instructors 
were  also  removed,  /i^ain,  a statistical  process  was  used.  This  con- 
trol was  applied  in  spite  of  the  fact  that  the  instructors,  to  reduce 
differences  among  themselves,  practiced  the  training  procedure  at  lengtli 
and  observed  the  practice  of  each  other. 

The  method  of  training  \nis  controlled  by  specifying  exactly  tiie 
orientation,  demonstration,  and  use  of  training  devices.  The  use  of 
reinforcement,  cueing  and  verbal  knowledge  of  results,  along  with  the 
traininj  methods,  were  practiced  until  each  instructor  was  verj'  pro- 
ficient in  their  use. 

Tne  experience  level  of  trainees  with  respect  to  tne  task  to  be 
learned  was  controlled.  By  using  only  men  from  another  MOS  Wiio  were 
naive  with  respect  to  Nike  Hercules,  no  trainee  used  in  this  research 
Imiew  an^^-thing  of  the  task  before  training  began. 
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Ii.3>:ructors. 


•’our  iKjrsous  sorvod  as  instructors  for  tais  resoarcli.  -Saca  of 
t..ese  -..jen  vas  a researca  ciiiployee  of  tlie  U.  G,  r>n.zy  /-Ir  Defense  IIiL.ian 
’.esearca  Unit. 

rroficienoy  ncasurement. 

ii.'ti  fidelity  simulator  of  tiie  SCI  (tae  hot  panel)  vas  pi’epared 
(see  fiyure  2)*  panel  of  this  device  wo.s  fully  functional  since 

all  swltcaes,  r.ieters  and  li{.;ats  operated,  appropriate  sounds  were  pro- 
vided, and  tae  intercom  and  handset -headset  operated.  Even  time  delays 
of  tae  tactical  equipment  occ’orred  during  operation  of  tlie  simulator. 

For  the  purposes  of  this  researca,  the  hot  panel  device  -v/as  considered 
equivalent  to  the  tactical  SCI  and  tae  relative  effectiveness  of  other 
training  devices  vas  evaluated  by  testing  the  trainees  on  tnis  hot  panel. 

For  the  proficiency  test,  a trainee  was  told  that  he  was  to  perform 
tae  j}2-step  procedure  using  the  hot  panel.  He  was  told  that  all  parts 
0:7  tae  device  operated.  Then  the  instructor  operated  a switch  which 
turned  on  the  Blue  Status  liglit  and  the  alarm  buzzer,  and  the  trainee 
began  tae  procedure  he  had  learned.  Tiie  instructor  continued  to  oper- 
ate the  instructor's  console  and  recorded  each  error  the  trainee  made. 

/ui  error  vas  recorded  for  each  step  omitted  or  taken  out  of  sequence. 

If  the  trainee  asked  a question,  the  question  ■vms  answered  and  an  error 
was  recorded  for  that  step.  If  the  trainee  made  an  eri'or  -vriiich  would 
aave  prevented  the  procedure  from  being  continued,  the  instructor 
corrected  that  error  and  recorded  it,  allowing  tiie  trainee  to  continue 
t;ae  test.  The  profic.-.ency  score  was  tlie  number  of  steps  performed 
correctly. 
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Figure  2.  High  Fidelity  SCI  Simulotcr 
(Hot  Panel) 


IBIS  PAGE  IS  BEST  QUALITY  PRAfiUCA^i* 
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At  no  tirne  was  tlie  ti'aiuee  nade  to  feel  rusaed.  Tlie  trainee  was 
told  t.:.at  time  was  not  a score  on  tliis  test  and  t.  .at  accurate  perfor- 
mance was  to  be  scored.  Actually,  total  test  time  was  I’ecorded  alon^c 
vritli  tl.e  proficiency  score. 

;ac-.  trainee  was  tested  in  tiie  same  roo::i  in  vniicn  training  nad 
been  conducted  and  in  tme  sane  order  as  ..e  performed  durin4;'  training. 
Only  tne  trainee  belnm  tested  and  the  instructor  v/ere  in  tne  room 
during  the  test.  Training  was  completed  about  IO3O  nours  and  testing 
was  done  between  I3OO  and  l^iOO  hours  tiie  seu-ie  day.  /.pproxirnately  ten 
minutes  vcve  required  to  test  one  trainee. 


Training  Devices 

Twelve  different  trainin':  devices  were  used  in  the  series  of 
studies  reported  h.ere.  A brief  description  of  eacn  device  .las  been 
presented  belov.'  to  give  the  reader  an  orientation  to  the  discussion  of 
each  separate  study. 

Tlie  I'Ot  Panel.  Tiiis  device  was  described  on  pa.ge  12  and  il- 
l..istrated  in  figure  2.  It  was  tiie  sar.ie  sice  and  shape  as  the 
tactical  SCI.  hvery  light,  switch,  i.ieter,  intercom,  and  tele- 
phone on  this  device  functioned. 

Tne  Cold  Panel.  On  tnis  device,  every  part  was  identical  witii 
t.'.e  corresponding  part  on  the  not  panel,  however,  tnere  was  no 
electrical  povrer  to  the  device.  T ierefoi'e  no  ligiits,  meters, 
intercom,  or  telepnone  functioned.  jJLl  switch.es  still  could 


be  operated. 
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The  yrozeii  Panel.  Ivei-y  part  on  the  Trozen  panel  was  nonoperahle . 
IIo  liitivL,  i-ieter,  intercom,  or  telephone  operated.  IIo  switch  opera- 
ted because  eac  i was  iirmiovauly  fixed  in  OIT  position. 

Cardboard  Panel.  The  entire  device  was  fabricated  of  card- 
board, iucludiiiij  tne  lousin;,.  The  panel  itself  was  painted  in 
color  to  resemble  tae  iiot  panel  above.  The  remainder  of  the 
device  was  painted  the  same  {tray  color  as  tiiat  of  the  other 
device  nousings. 

Photoitrapaic  Panel.  This  device  was  a full-sized  black  and  wiiite 
piiotograpaic  print  of  the  not  panel  above. 

Drawing  Panel.  This  device  was  a full-sizeJ  black  and  white 
line  drawing  of  the  not  panel  described  above. 
hi-Fi  Housing.  This  device  was  a replica  of  the  wooden  housing 
of  t le  hot  panel,  with  the  cold  panel  installed  during  training. 

Pox  nousiii;,..  Tuis  device  \ras  a box  made  of  plyirood.  It  \ms  of 
appropriate  size  and  siiape  to  nold  the  cold  panel,  which  was 
installed  in  this  device  during  training. 

Fraiiie  housing.  This  device  was  a simple  wooden  frame  of  appro- 
priate size  to  i'.old  euid  support  the  cold  panel. 

I’ull-oized  Panel.  Tr.is  device  was  aLJOst  identical  with  tne 
di-awing  panel  described  above  and  was  also  a line  drawing.  It 
!ias  been  differentiated  from  the  drawing  above  because  on  tlie 
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i’ull-sized  panel  t lo  lettering  was  larger  t.ian  that  on  the  draw- 


ing naiiol.  The  xAill-sized,  22"  x 30",  panel  was  used  in  a study 
Ox  size. 

ali.'-2ized  Panel.  Tuis  device  was  a i;,;"  x 22"  reproduction 
0'7  t.ie  xull-sized  panel  above  and  was  one-aair  the  area  of  the 
iull-sized  panel. 

Si.'.all  x^anel.  Tnis  device  was  a 5"  x (’"  reproduction  ox  the 
xull-sized  panel  and  was  one-nineteentii  tne  area  of  tne  full- 
sized  device. 

l^ictional  Fidelity  - Study  I 

In  L.  -is  study,  three  levels  of  functional  fidelity  wen;  defined, 
heasurerient  of  the  dimension  was  categorical,  and  no  assumption  was 
made  that  the  categories  were  equidistant  from  one  another. 


Training  devices. 

The  hot  panel  has  uoen  described  above.  It  represents  very  high 
fidelity. 

Tiie  second  device  vras  called  the  cold  panel  (see  Figure  3)* 
ivery  part  of  this  panel  ira,s  identical  in  appearance  to  a corre- 
sponding part  on  the  iiot  panel.  However,  none  of  the  lights  would 
illvUiinate,  and  none  of  the  meters  would  register.  Txie  Handset- 
Headset  would  not  operate,  althougii  it  could  be  plugged  into  the 
panel  face.  Tae  intercom  did  not  function,  and  no  sounds  were  pro- 
duced by  the  device,  /ill  switclies  were  functional  in  that,  when  tire 
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trainee  pressed  tiie;:i  or  twisted  them,  they  moved  properly.  This  de- 
vice represented  a reduction  in  functional  fidelity. 

Tile  tnird  device  was  called  the  frozen  panel  (see  Figure  h). 
/if;ain,  every  part  was  identical  in  appearance  to  a corresponding 
part  on  tne  not  panel.  However,  no  part  on  the  frozen  panel  would 
operate.  Not  only  would  the  lights,  meters,  intercom,  and  Handset- 
ileadset  not  operate,  ’out  all  switches  were  locked  in  one  position. 
Tiiis  device  represents  the  minimum  level  of  functional  fidelity  for 
a device  which  retains  tiaree  dimensional  quality. 

Collection  of  the  data. 

Four  groups  of  five  men  were  trained  to  perform  the  92-8tep  pro- 
cedure with  each  of  the  above  devices.  Two  instructors  each  trained 
one  five-man  group  and  a third  instructor  trained  two  five-man  groups 
with  each  device.  Fach  instructor  administered  proficiency  tests  to 
those  men  v^horj  he  trained.  Tiius,  20  men  were  trained  with  each  panel. 

/uialysis  of  the  data  and  results. 

Control  of  the  effects  of  trainee  intelligence  was  obtained 
through  analysis  of  covariance  in  which  proficiency  scores  were  ad- 
justed for  variation  associated  with  GT  scores. Tlie  adjusted  pro- 
ficiency scores  were  tested  for  differences  due  to  use  of  the  three 

^ Tests  of  homogeneity  of  regression  were  performed  to  assess 
tiie  legitimacy  of  this  analysis,  and  tlie  results  have  been  presented 
in  Appendix  Tables  C-2,  C-3,  and  G-4.  In  each  case,  the  hypothesis 
of  homogeneity  of  regression  was  retained. 
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differeirt  panels,  differences  due  to  the  three  instructors,  and 
interaction  effects  associated  vith  panels  by  instructors.  The 
overall  unadjusted  proficiency  score  mean  was  u4.7»  '■•'hen  the  af- 

fects of  intelligence  (as  measured  by  GT)  -vrere  removed  from  the 
proficiency  scores,  no  differences  in  proficiency  vere  found  which 
’./ere  associated  with  traininc  devices,  instructors,  or  the  inter- 
action between  devices  and  instructors  (p  > .05).  Tne  distributions 
of  proficiency  scores  eire  presented  in  Appendix  Table  G-5.  Results 
of  tiie  covariance  analysis  are  presented  in  Appendix  Table  C-6.  Ap- 
pendix Tables  C-7  and  G-6  contain  the  unadjusted  and  ad,5usted  mean 
proficiency  scores. 

Tiie  traininc  procedure  allowed  the  total  traininc  time  for  each 
five-man  croup  to  vary.  The  fastest  group  completed  training  in  2 
hours,  15  minutes  while  the  slowest  group  completed  training  in  3 
hours,  30  minutes.  Tlie  mean  traininc  time  was  2 hours,  4l  minutes. 

Since  the  mean  training  time  for  each  group  was  not  correlated  with 
the  mean  GT  score  for  the  group  (r  = .22,  p > .05),  a covariEuice 
analysis  of  training  time  scores  was  not  considered  to  be  either 
necessary  or  useful.  To  determine  if  there  were  significant  dif- 
ferences among  training  times  for  panels  and  instructor  groups,  an 
analysis  of  variance  was  performed  (Lindquist,  1953^  P»  15u).  The 
results,  presented  in  Appendix  Table  G-9,  showed  that  differences 
ar.ionr  training  times  for  panels  and  instructors  were  within  chance 
expectation  (p  > .05).  The  training  time  means  for  panels  and  in- 
structors are  presented  in  Appendix  Table  G-10. 
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Two-W-menslonal  Three-Ittmensional  Devlces-Study  II 

When  a frozen  panel  was  used  for  training,  trainees  could  and 
did  reada  out  and  handle  the  various  switches  sind  knobs  on  the  panel 
face.  This  tactile  and  kinesthetic  behavior  was  conceived  as  endow- 
ing the  frozen  panel  with  some  degree  of  functional  fidelity.  Thus, 
a panel  which  was  a flat  surface  would  represent  a lower  degree  of 
functional  fidelity  because  the  flat  surface  would  reduce  sensory 
effects  from  touch  and  kinesthesis.  Following  this  line  of  reason- 
ing, the  following  training  devices  were  prepared. 

Training  devices. 

The  first  training  device  was  the  hot  panel.  This  was  the  same 
device  as  was  used  in  the  first  study.  The  frozen  panel  from  the 
first  study  was  also  used  here.  These  two  panels  were  considered 
to  represent  the  functional  fidelity  category  "three-dimensional." 

A full-sized  black  and  white  photograph  of  the  hot  panel  was 
prepared.  This  photograph  was  mounted  on  plywood  and  installed  in 
place  of  the  frozen  panel  (see  Figure  5)*  This  device  was  considered 
to  be  one  technique  of  representing  the  "two-dimensional"  category  of 
functioneLL  fidelity. 

A full-sized  bladc-on-whlte  line  drawing  was  used  as  another 
two-dimensional  device.  Ihe  spatial  relationship  of  panel  control 
elements  was  maintained  by  showing  all  peurts  on  the  panel  face  In  as 
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Figure  5-  Photograph  Panel 


Drawing  Panel 
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tnie  size  and  configuration  as  the  mode  of  representation  permitted. 
The  drawing  was  mounted  on  plywood,  shielded  with  plastic,  and  in- 
stalled just  as  the  photograph  had  been  (see  Figure  6). 


’Recognition  is  given  to  the  fact  that  there  are  appearance  dif- 
ferences between  each  of  the  two-dimensional  devices  and  any  one  of 
the  three-dimensional  devices.  Thus,  there  is  some  confo'uiding  of 
appearance  fidelity  and  functional  fidelity  in  this  study.  Regardless 
of  the  confoxmding,  the  study  seems  worthwhile  on  a practical  basis. 

Collection  of  the  data. 

The  data  collected  for  the  hot  panel  and  frozen  panel  of  Study  I 
were  used  again  in  this  study.  Collection  of  data  with  the  photo- 
graph a:.d  drawing  panels  followed  the  pattern  described  for  Study  I. 
Four  five-man  groups  were  trained  using  each  device  to  train  20  men. 

Two  instructors  trained  one  five-man  group  with  each  panel,  while  the 
third  instructor  trained  two  groups  with  each  panel.  Since  four  train- 
ing devices  were  used,  a total  of  8o  trainees  were  used  for  this  study. 

Analysis  of  the  data  and  res^llts. 

An  analysis  of  covariance  was  perfoimed  on  the  proficiency  scores, 
intelligence  being  controlled  with  GT  scores .i/  The  adjusted  profi- 
ciency scores  were  tested  for  differences  due  to  panels,  differences 
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due  to  instructors,  and  effects  of  panels  ty  instnictors  interaction. 

The  resvLLts  of  this  analysis  have  been  presented  in  Appendix  Table  C-l4 
and  show  that  none  of  the  above  factors  produced  differences  among  ad- 
justed proficiency  scores  larger  than  chance  (p  > .05).  The  overall 
unadjusted  mean  proficiency  score  was  8k. k.  A distribution  of  unad- 
justed proficiency  scores  appears  in  Appendix  Table  C-I5.  Unadjusted 
proficiency  score  means  are  in  Appendix  Table  C-16,  and  adjusted  pro- 
ficiency score  means  are  in  Appendix  Table  C-I7. 

As  in  the  firsu  study,  training  time  was  found  to  be  uncorrelated 
with  GT  scores  (r  = .11,  p > .05).  An  analysis  of  variance  was  per- 
formed on  the  training  times  to  determine  if  instructors  or  panels 
differed  significantly  in  training  time  (Lindquist,  1953/  P*  15^). 

The  results  of  this  analysis  are  presented  in  Appendix  Table  C-I8  and 
show  that  no  significant  differences  in  training  times  can  be  attributed 
to  different  instructors  or  to  the  use  of  different  panels  (p  > .05). 

The  fastest  group  coii5)leted  ti-aining  in  2 hours  15  minutes,  the  slowest 
group  in  3 hours  30  minutes,  and  the  mean  training  time  was  2 hours 
k8  minutes.  Appendix  Table  C-19  presents  the  meEuti  training  times  for 
instructors  and  peinels. 

Reduced  Housing  Fidelity  - Study  III 

This  study  differed  from  the  previous  ones  In  that  appeeoeince 
fidelity  was  the  quality  being  investigated  as  opposed  to  functioned. 


fidelity. 


Tile  specii’ic  appearance  fidelity  being  considered  v/as  tiia^ 


of  r.o.ising  for  a training  device.  During  this  tasl:,  tue  operator 
neltaer  perfor.is  any  actions  on  nor  receives  any  procedural  signals 
froi.;  t.ie  housing.  Tne  housing'  was  a structure  iraich  supported  the  SCI 
pa'-iel.  T.-is  i.ieant  that  for  the  task  being  trained  the  housing  should 
.iavG  no  great  inportance  to  the  trainee.  Only  if  the  trainee's  at- 
titude toward  the  device  was  negative  because  the  housing  looked  un- 
ree.listic,  and  if  attitude  affected  a trainee's  proficiency  score, 
would  tie  appearance  of  tae  housing  be  important. 

Training  devices. 

Since  tiie  previous  work  aad  sho'wn  that  lo'wer-taan-perfect  func- 
tional ridelit„.  panel  faces  could  be  used  to  train  r,ien  for  this  task 
without  affecting  proficiency  level,  a cold  panel  (see  Figure  3)  was 
selected  for  use  in  tais  study.  The  cold  panel  could  be  moved  from 
housing  to  aouatinf:  easily,  a aigh  fidelity  housing  already  existed 
for  i'fc,  and  ti^e  p€in^4»  was  inexpensive  to  build. 

The  high  fidelity  iiousing  vjas  as  near  identical  to  tlie  hot  panel 
;'.o  '.sin';  as  a aand.iade  cabinet  could  be.  It  represented  tlie  highest 
Ic'.'cl  of  appearance  fidelity  in  this  study,  and  it  has  been  shown  as 
V'ig'ure  ;.  /uiot.ier  housing  was  prepared  as  a box.  Tliis  device  •would 
old  t.\e  cold  panel  in  the  proper  position  and  conceal  the  back  side 
o ' oae  panel  (see  Figure  o).  T!ie  box  was  painted  the  same  gray  color 
as  was  the  higr.  fidelity  -.ousing.  Tliis  box  represented  a reduction  in 
*.ousinj  fidelity.  The  third  housing  was  a simple  frame  (see  Figure  9)« 
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This  frame  was  neatly  constructed  tut  only  supported  the  cold  panel. 

It  did  not  conceal  the  back  of  the  panel.  The  frame  represented  the 
lowest  level  of  housing  fidelity  used  in  this  study. 

Collection  of  the  data. 

Each  of  three  instructors  trained  one  five-man  group  with  each 
of  the  housings  using  the  cold  panel.  Proficiency  scores  were  collected 
on  45  trainees,  as  previously  described,  using  the  hot  panel  for  the 
test. 

Analysis  of  the  data  and  results. 

A distribution  of  the  proficiency  scores  is  presented  in  Appendix 
Table  C-20.  The  data  were  tested  for  homogeneity  of  regression  within 
cells.  The  test,  presented  in  Appendix  Table  C-21,  showed  that  the 
assumption  of  homogeneity  of  regression  within  cells  was  not  tenable. 
Thus,  a two-way  analysis  of  covariance  which  was  originally  planned  was 
not  legitimate. 

A test  was  performed  to  determine  the  homogeneity  of  regression 
among  the  three  housings.  The  test  demonstrated  that' the  assumption 
of  homogeneity  of  regression  was  tenable  for  housing  effects  (see 
Appendix  Table  C-22. 

A siiig)le  analysis  of  covariance  was  performed  on  the  proficiency 
scores.  In  this  analysis,  proficiency  scores  were  adjusted  for  in- 
dividual differences  associated  with  GT  scores.  As  shown  in  Appendix 
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Table  C-23,  no  differences  among  adjusted  housing  means  were  found 
beyond  those  which  chance  would  have  produced  (p  > .10).  The  means 
for  unadjusted  and  adjusted  proficiency  scores  have  been  presented 
in  Appendix  Table  C-2U. 

The  training  times  for  each  of  the  nine  groups  were  correlated 
, with  the  mean  GT  score  for  that  group.  The  resulting  coefficient  was 

I 

r = .15,  p > .05.  Since  the  correlation  was  not  significantly  dif- 
ferent from  zero,  no  correction  for  GT  differences  was  applied  to  the 
training  times. 

The  training  time  scores  were  submitted  to  an  analysis  of  variance 
to  determine  housing  and  instructor  time  differences.  No  significant 
differences  in  training  time  were  found  to  be  associated  with  housings 
or  instructors  (p  > .10).  These  findings  are  summarized  in  Appendix 
Table  C-25.  Appendix  Table  C-26  presents  the  mean  training  times. 

Cardboard  Mock-Up — A Replication  - Study  IV 

A suggestion  was  made  to  use  a mock-up  of  the  SCI  fabricated 
from  cardboard.'^  Accepting  this  suggestion  not  only  meant  develop- 
ment of  the  mock-up  and  testing  its  teaching  effectiveness,  but  it 
gave  the  opportunity  to  repeat  the  test  of  two-  three-dimensional 
devices  and  to  vary  housing  appearance. 


-/  This  suggestion  was  made  by  Mr.  C.  W.  Polvogt,  who  was 
working  for  the  U.  S.  Army  Air  Defense  Human  Research  Unit  as  an 
artist  illustrator. 
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Training  devices. 

Two  devices  from  the  previous  studies  were  used  again  in  this 
research;  the  hot  panel  and  the  cold  panel.  The  third  device  was  a 
cardboard  mock-up  of  the  SCI.  A picture  of  this  device  is  presented 
in  Figure  11.  Hie  housing  of  this  device  was  painted  to  match  the 
color  of  the  high  fidelity  housing.  The  face  of  the  panel  was  drawn 
to  scale  and  parts  on  the  panel  were  painted  in  color  to  resemble 
those  of  the  illuriiinated  hot  panel. 

Thus,  the  hot  panel  represented  full  functional  and  housing 
fidelity.  The  cold  panel  represented  a three-dimensional  reduction 
in  functional  fidelity  and  full  housing  fidelity.  Tlie  cardboard  panel 
represented  a two-dimensional  reduction  in  functional  fidelity  and  a 
reduction  in  appearance  fidelity  for  both  the  panel  and  housing. 

Collection  of  the  data. 

Collection  of  data  followed  the  pattern  previously  described. 
Three  instructors  gathered  the  data.  Each  instructor  trained  one 
five-man  group  with  each  device.  Thus,  each  instructor  trained  15 
men,  and  15  men  were  trained  with  each  device.  Training  was  conducted 
using  the  hot  panel,  then  the  cold  panel,  and  finally  the  cardboard 
mock-up.  In  all,  4-5  trainees  were  used  in  this  study. 

;1 
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Analysis  of  the  data  and  results. 

An  analysis  of  covariance  was  performed  on  the  proficiency  scores. 
Intelligence  variation  being  controlled  with  GT  scores.'^  The  adjusted 
proficiency  scores  were  tested  for  differences  associated  with  panels, 
with  instructors,  and  with  the  panels  by  instructors  interaction.  The 
results  of  the  covariance  analysis  showed  that,  when  intelligence  was 
controlled,  there  were  no  differences  associated  with  proficiency 
which  could  be  attributed  to  panels,  instructors,  or  to  panel  by  in- 
structor intei'action  (p  > .10).  Distributions  of  proficiency  scores 
are  presented  in  Appendix  Table  C-30.  Means  of  the  unadjusted  pro- 
ficiency scores  for  the  various  groups  are  presented  In  Appendix  Table 
C-31.  The  adjusted  mean  proficiency  scores  were  prepared  as  Appendix 
Table  C-32.  A suimnary  of  the  covariance  ccmputatlons  has  been  placed 
in  Appendix  Table  C-33* 

The  correlation  between  group  training  times  and  GT  scores  was 
computed.  The  resulting  coefficient  was  r = .23  which  was  not  sig- 
nificantly different  from  zero  (p  > .05).  Thus  covariance  analysis 
to  control  for  intellectual  function  was  not  performed.  Rather,  an 
analysis  of  variance  was  perfonned  on  the  group  training  times.  This 
analysis  examined  the  training  times  for  differences  associated  with 


Tests  of  homogeneity  of  regression  for  these  data  may  be 
found  in  Appendix  Tables  C-27,  C-28,  and  C-29. 
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the  tliree  panels  and  the  three  Instructors.  N(||||||^fferences  beyond 
chance  (p  > .lO)  were  found  to  be  attributable  to  eithei'  instructors 
or  panels.  Tlie  results  of  the  analysis  have  been  presented  in  Ap- 
pendix Table  C-3^.  Mean  training  times  for  panels  and  instructors 
are  presented  in  Appendix  Table  C-35- 


Reduced  Size  of  Device — Study  V 


Tlie  objective  of  this  study  was  to  determine  the  effects  on  pro- 
ficiency when  the  size  of  a training  device  was  reduced.  The  results 
of  the  previous  four  studies  were  considered  in  designing  the  present 
investigation  and  produced  changes  which  sing^lified  the  work. 

Training  devices. 

Line  drawings  were  used  as  training  devices  throughout  the  size 
investigation.  Three  facts  affected  this  decision.  Study  II  had 
demonstrated  that  a drawing  was  as  effective  as  was  a hot,  cold, 
frozen,  or  photographic  panel.  Drawings  were  the  least  expensive  to 
prepare  of  the  five  devices.  And  drawings  were  very  easy  to  produce 
in  the  three  sizes  selected  for  this  research.  The  following  devices 
were  used: 

1.  Full  sized  panel.  This  was  a black -on -white  line  drawing 
of  the  hot  panel.  It  was  the  same  overall  size  (22"  x 30") 
and  the  panel  parts  were  the  same  size  as  those  of  the  hot 
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panel.  Tlie  lettering  on  this  panel  was  somewhat  larger  than 
that  on  the  hot  panel.  Otherwise,  this  device  was  the  same 
as  the  panel  shown  in  Figirre  5- 
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2.  Half  sized  panel.  A photographic  plate  was  made  of  the  full 
sized  panel,  and  15"  x 22"  prints  were  made  from  the  plate. 
These  prints  were  one-half  the  area  of  the  f\ill  sized  panel, 
and  each  was  mounted  on  stiff  cardboard. 

3.  Small  panel.  A second  plate  was  made  of  the  full  sized 
panel,  and  5"  x J"  prints  were  made  from  the  plate.  These 
prints  were  mounted  on  stiff  cardboard  for  the  small  panels. 

The  relative  sizes  of  the  three  panels  is  illustrated  in  Figure 

12. 


\ 


Training  methods. 

Use  of  the  small  panel  forced  a change  in  the  training  method  used 
in  previous  studies.  The  reader  will  recall  that  heretofore  the  train- 
ing device  was  displayed  to  a five-man  group,  and  all  training  was  given 
with  the  panel  in  a position  such  that  every  trainee  coTold  see  it  all  the 
time. The  5"  x 7"  panel,  however,  was  too  small  for  group  instruction  and 
a copy  would  have  to  be  given  to  each  student.  Since  the  size  of  the 
device  would  force  a change  in  device/student  ratio,  the  effect  of  the 
device/ student  ratio  was  evaluated  in  this  study  by  using  two  different 
training  methods. 
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Figiire  12 


Relative  Sizes  of  the  Three  Panels  for  Study  V 


Training  Method  I used  the  5/l  student  device  ratio  and  training 
procedures  described  previously.  This  method  was  used  both  for  the 
fuLl  sice  panel  (22"  x 30")  and  the  15"  x 22"  reduction.  In  Training 
Method  II,  each  trainee  was  given  a panel  identical  with  that  being  used 
by  the  instructor.  Tlie  instructor  demonstrated  the  procedure  as  before, 
pointing  to  Ms  panel  as  he  proceeded.  Each  trainee  followed  the  demon- 
stration using  his  panel  to  see  details  and  glancing  at  the  instructor 
for  general  direction.  After  the  demonstration,  the  instructor  re- 
quired one  trainee  to  perform  tlie  procedure  using  his  own  panel,  giving 
verbal  responses  and  putting  his  finger  on  the  panel  part  that  was  being 
operated.  Tlie  other  trainees  were  instructed  to  follow  the  performer  on 
their  own  panels  and  to  be  prepared  to  give  a correct  action  if  called 
on  to  do  so.  Wiien  the  performer  made  an  error  the  instructor  stopped 
him  and  asked  one  of  the  observers  what  the  correct  action  should  have 
been.  Wlien  the  correct  action  was  identified,  the  performing  trainee 
was  required  to  give  the  correct  verbal  response  and  to  continue  the 
procedure.  This  process  was  continued  \intil  the  perfoiming  trainee  had 
conpleted  all  92  steps.  At  this  point,  a second  trainee  acted  as  the 
performer  and  the  first  became  an  observer.  This  process  was  continued 
until  each  trainee  had  served  as  a performer  twice  and  an  observer  eight 
times. 

TMs  training  method  was  used  with  both  the  5"  x 7"  panel  and  the 
15"  X 22"  panel. 
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Trainees . j 

1 

As  in  the  previous  studies^  men  for  tills  research  were  in  train-  ' 

ing  foi-  ^DS  192.  Fi-om  tills  group,  no  man  was  selected  whose  GT  score  j 

was  helow  TO.  Othei-visc  each  of  the  60  trainees  used  here  was  selected  j 

at  randisii  from  the  MOS  192  trainee  group  which  was  on  post  while  the  j 

stiidj'  was  being  perfoimied. 

Instmctors . 

IVo  of  the  researchers  seinred  as  instructors  in  this  study.  Each 
of  them  had  served  as  an  insti-uctor  in  the  other  four  studies. 

Training  eonditi ons . 

Training  was  performed  under  four  conditions,  and  three  five-man 
groups  were  trained  under  each  condition. 

1.  A full  sized  device  was  used  with  Method  I. 

2.  A half  sized  device  was  used  with  Method  I. 

3.  Half  sized  devices  were  used  with  Method  II. 

4.  Small  devices  were  used  with  Method  II. 

Randomization. 

The  reader  will  recall  that  several  factors  were  statistically 
controlled  in  the  previous  four  studies,  and  that  of  these  factors 
oi-ily  GT  level  was  significantly  associated  with  proficiency  scores. 

To  simplify  the  procedures,  these  controls  were  dropped  in  the  present 
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ctudy.  Trainees  and  instructors  were  randomly  assigned  to  five-man 
groups.  Groups  were  randomly  assigned  to  the  four  training  conditions. 
And  trainees  were  randomly  assigned  to  a position  in  a rotational  order 
of  training. 

Collection  of  the  data. 

One  five-man  group  was  trained  each  day.  Training  began  at  ap- 
proximately 0730  hotirs  and  was  completed  about  1000  hours.  The  group 
was  released  and  returned  at  13OO  hoiirs  for  proficiency  testing.  Tlie 
proficiency  test  was  the  same  as  for  the  previous  studies. 

Analysis  of  the  data  and  results. 

Mean  proficiency  scores  were  computed  for  each  of  the  four  train- 
ing conditions  (see  Appendix  Table  C-36).  To  estimate  the  effect  of 
training  method  on  proficiency,  with  device  size  held  constant,  the 
mean  proficiency  scores  from  conditions  two  and  three  were  submitted 
to  a t-test.  Tlie  means  were  not  significantly  different  from  each 
other  (t  = .77^  P > .10).  This  finding  was  interpreted  to  mean  that 
method  of  training  did  not  effect  proficiency  development  in  the  pre- 
sent situation.  Therefore,  the  proficiency  scores  were  treated  with 
analysis  of  variance  to  estimate  the  effect  of  size  of  device  on  pro- 
ficiency development.  Data  from  conditions  two  and  three  were  pooled 
for  this  analysis.  The  result  was  an  F - ratio  of  I.08  which  was  not 
significant  at  the  .10  level  of  confidence  (see  Appendix  Table  C-37). 
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A Field  Study  - Study  VI 


To  this  point,,  the  studios  liad  shown  tliat  various  reductions  in  fi- 
delity of  training  devices  had  not  effected  the  development  of  proficiency 
nor  increased  the  training  time.  However,  the  instructors  had  heen  re- 
searciiers  anti  the  trainees  had  known  that  the  training  was  experimental 
and  not  practical  to  them.  Also,  the  training  conditions  had  been  con- 
trolled as  in  a laboratory.  The  above  factors  were  not  typical  of  the 
usual  Anry  training  circxmstances.  A field'  study  v/as  designed  in  which 
military  Instructors  trained  soldiers  who  knew  that  they  would  be  as- 
signed to  duty  requiring  them  to  perform  the  task  on  which  training  was 
given.  In  addition,  the  training  was  given  under  circumstances  much  more 
like  those  usually  fovmd  in  Army  training.  This  field  study  was  conducted 
to  detenrdne  if  the  reduction  of  device  fidelity  would  still  have  no  ef- 
fect cn  proficiency  development  or  training  time  under  these  more  realistic 
conditions . 

Training  Devices 

The  low  fidelity  training  device  was  the  line  drawing  used  in  Study  II 
installed  on  the  frame  housing.  It  was  chosen  because  it  seemed  likely  that 
if  one  of  the  reduced  fidelity  devices  was  selected  for  Amy  use,  the  di’awing 
would  be  the  choice  because  it  was  economical  to  develop  and  reproduce.  The 
high  fidelity  training  device  was  the  actual  tactical  SCI,  the  equipment 
which  was  being  used  in  the  current  Amy  training  program.  Tlie  pianel  of  the 
tactical  SCI,  as  installed  for  training,  will  Ilinction  completely  for  one 


Laiuiclici-  and  only  ^'ai'tly  I'oi'  the  other  thrj^  laiuiehera.  At  tliitc:;,  tliei'e 


in  no  pi-'Wei'  tu  the  dCI  because  of  iiialltinetions  in  other  equipment  i; 


system  being  used  i'or  training. 


Instruotoi's 


Each  instructor  used  in  the  field  study  was  currently  qualified  and 

instructing  in  the  I77  MOS.  Selection  of  instructors  was  not  controlled 
/ • , 

by  the  researchers.  Esther,  permission  was  obtained  to  use  trainees  fui- 
the  study  as  they  wez'e  received  by  the  Batteries  from  Basic  Combat  Ti’alning. 
Tliese  trainees  were  routinely  assigned  to  training  groups  and  the  groups 
were  assig:ied  to  instructors.  Tliere  is  no  reason  to  suppose  that  selec- 
tion of  instructors  for  the  field  study  was  other  than  random. 


Ti-ainees 


From  the  above  description,  the  reader  can  see  that  there  was  no 
reason  to  suspect  that  assignment  of  trainees  to  the  field  study  was  otlier 
tlian  random.  Each  trainee  had  completed  Basic  Combat  Training  and  had 
i^een  assigned  to  Advanced  Individual  Training  for  MOS  177- 


Treatments 


The  _SCI  panel  di-awing  was  used  as  the  training  device  for  the  experl - 
m.ental  treatment.  The  trainees  were  given  a tour  of  the  training  site  and 
shown  each  piece  of  Nike  Hercules  equipment.  A short  explanation  of  the 
function  of  each  piece  of  equipment  was  also  given  t)ie  trainees.  Tliesi, 
t'’ainees  were  assigned  to  groups  of  fr(.)m  9 to  I3  men  each,  and  training 


began. 


'ilu!  tralnccD  v;crf  t:  t ' ■ i rfi.  111  P Sl-ttu:.  and  hod  Gtatuc  pro- 

ccdurcG,  jur.t  ac  had  hcon  done  in  the  previous  ntudiec.  Each  Inctructor 


1 • need  the  training  tcclmiqucc  he  already  knev/.  A rencarchcr  oheerved  thi  c 

j training.  Tlie  training  was  conducted  in  a room  oi’dlnai’ily  used  ac  an  Aimy 

, ’lasci’oom  and  during  the  regularly  scheduled  training  day. 

; As  the  instructor  '’■.termined,  through  his  own  proficiency  ectimatec, 

tiiat  a trainee  had  attained  sufficient  proficiency  to  proceed  to  other 
training,  the  trainee  was  taken  to  another  building  and  given  a proficiency 
; test  by  one  of  the  researchers.  The  observing  researcher  also  noted  the 

total  number  of  hours  of  training  required  for  each  tiamee  to  reach  this 

I 

proficiency  level. 

Tile  tactical  SCI  was  used  for  the  control  treatment,  '"raineec  were 
given  the  same  orientation  and  group  assignment  as  described  above  for  the 
cxpei’imental  treatment.  The  same  task  was  taught  to  them,  and  a researcher 
observed  the  training.  The  training  was  given  outdoors  In  a sandbagged  area 
to  the  front  of  which  was  the  tactical  SCI. 

The  instructors  performed  just  as  they  normally  did,  using  techniques 

I 

which  they  already  knew  well.  When  an  instructor  determined  a trainee  to 
be  sufficiently  proficient,  the  trainee  was  given  a proficiency  test  by  a 
researcher.  The  observing  researcher  recorded  the  training  time  for  each 
i trainee  as  before. 

1 

7 Proficiency  Test 

L The  same  proficiency  test  was  used  in  this  study  as  had  been  used  in 

I the  previous  studies,  and  all  tests  were  administered  by  the  same  researcher. 
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I'l'ioi’  to  ucc  of  llie  liigli  fiiiolity  ciiiadator  ac  tlic-  tooting  device'  for  thi  r. 


tiold  r.tudy,  lb  tralnocc  who  had  been  trained  on  the  tactical  SCI  wore  given 
tlu'  proficiency  toot  on  both  the  tactical  SCI  and  on  tlie  high  fidelity  cimu- 
Lator.  niece  two  sets  of  proficiency  ocores  were  correlated,  r = .80.  Tide 
war.  concidci'ed  rul'ficicnt  evidence  of  tlie  validity  of  tlie  proficiency  tort 
adiianiGtered  with  the  high  fidelity  cimulatur  to  justify  its  use  for  pro- 
ficiency testing  in  this  field  study. 

Data  Collection 

A total  of  3b  men  were  trained  with  the  experimental  treatment  by  tliree 
instructors,  each  ol’  whom  trained  one  group  of  men.  Training  alv.'ays  began 
on  I-ionday  and  was  completed  by  Tliursday  of  the  same  week.  Anotlier  35  nicn 
wore  trained  by  four  different  instructors  v;ho  used  the  control  treatment. 
Tiie  same  genera.1  training  schedule  was  followed  as  above. 


Analysis  and  Results 


Meaji  proficiency  scores  were  computed  for  each  of  the  above  treatment 
tT’oups.  Tlie  mean  proficiency  score  for  the  control  group  was  77-03  and  for 
the  experimental  group  78-33-  A t-test  of  the  difference  between  these 
means  was  t = -7^1,  and  showed  the  difference  was  well  within  the  chance 
level  (p  > -05)-  Mean  training  times  were  computed  for  the  two  treatment 
groups.  The  mean  training  time  for  the  control  group  was  12.62  hours  and 
for  the  experimental  group,  10.35  hours.  Tliese  two  mean  times  were  te.sted 
for  differences  witli  a ^-test  and  found  to  be  no  more  different  than  cliancc 
would  allow  (t  = 1.835j  P > -05)- 
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The  i’ovir  i iiuti’uetoiT.  \:\\o  vicrh  Uu'  liiii'  iira\.’j  iif,  i’oi- 
i iiti'i’vi  \.'licu  t i'aiiiint;  CDinpLeli  ii . Rich  ul'  t.liCL'.f  iiciti'uctor!:  had 

t2‘a.liU'd  null  with  tlio  tactical  SCI  aa  a part  oi'  tluii-  ri'tiulai’  iiiEtJ’uctional 

diutlcT..  Tlii’ce  baric  que-ntionr  were  arked  of  eacli  inctructor; 

War  the  prol'icieiicy  ievei  oT  men  ti’aiiu'd  witli  the  di-awing  ar  liiyh 
ar  that  ol’  men  ti’aiued  with  the  tactical  SCI?  One  inntructor  gave  a dcTiuitc' 
lugative  reriwnre.  Tliir  same  man  was  negative  in  liis  attitude  to  the  ih-aw- 
ing  tlirougliout  the  cxpi'riment.  However,  lie  cooperated  well.  'IVo  other 
instructors  gave  a quatified  and  mild  "no"  answer  to  tiic  question.  Tlie 

other  instructor  gave  a veiy  positive  "yes."  Thus,  the  instructoi's  wiu'e 

balanced  about  evenly  in  thdr  attitudes  towai-d  the  proficiency  level  of 
the  lii’awing-trained  trainees. 

2.  Was  more  training  time  requii'od  when  the  drawing  was  used  than  wlien 
tlie  tactical  SCI  was  used?  One  instiaictor  said,  "Yes."  liie  other  tlu'oe 
gave  negative  replies  saying  that  there  was  no  time  diffei’cnce. 

3.  Was  more  work  involved  when  the  drawing  was  used?  Two  instructoi's 
replied,  "Yes."  Tliey  said  that  the  extra  explanation  (observed  by  research 
instructors)  made  instructing  with  the  tlrawing  more  work  than  instructing 
v.'lth  the  tactical  SCI.  Tlie  other  two  instructors  replied,  "No."  Tliey  said 
that  instructing  with  the  drawing  was  easier,  not  because  of  the  device 
itself,  but  because  the  training  was  indoors  where  the  instructor  had  bettor 
control  of  the  attention  of  trainees. 


I>j  L'.cuGrdoii  ami  CoiicLunionc 

Fi’cviouc  coctioiiL'  oV  the  I'oport  have  deneribed  thr  research  ob jecti vea, 
the  t.'ietlied;; . and  tile  I’ccuLtc  of  tlie  ntmliec.  llie  precent  r.eetioii  dincuecec 
blh  I’ee.ultr,  and  theii’  implicationr.. 

FunetlonaL  fidelity. 

The  first  ctmly  vai’lcd  functional  fidelity  at  three  categorical  Levels 
wliile  maintaining  the  three-dimensional  quality  of  the  devices.  Tlie  major 
finding  of  the  first  study  was  that  men  can  be  trained  to  perfonr.  a ijro- 
ceiiurc  a;  well  with  nonoperating  devices  as  they  can  with  a functional 
devict  . Tile  second  study  extended  the  reduction  of  functional  fidelity  to 
two-tUmensional  devices.  The  second  study  revealed  that  men  can  be  trained 
to  jcrfciTi  a procedui’e  as  well  with  full  size  photographs  and  drawings  as 
they  ca.  be  with  a perfectly  functional  device.  The  fourth  study  replicated 
the  first  two  stuiUes,  varying  the  form  of  the  two-dimensional  device.  The 
findings  of  the  fourth  study  confirmed  those  of  the  previous  two  studies, 
wl'.ich  lends  confidence  to  the  validity  of  the  results.  Tlie  field  study 
showed  that  the  above  findings  apply  where  military  instructors  are  train- 
ing soldiers  to  whom  the  training  is  realistic. 

Other  investigators  have  reached  similar  conclusions.  Denenberg  (l95^) 
studied  the  transfer  of  training  effects  of  an  inexpensive  mock-up  of  a 
tank  hull  and  found  that,  for  starting  and  stopping  procedures,  the  mock-up 
was  as  effective  as  was  the  tank  itself.  Wliile  studying  the  training  of 
ground  cockpit  procedures  for  eui  aircraft,  training  on  a simple  cockpit 
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moek-up  i/ac  found  to  ti-ancfcr  very  wc'LI  to  px’oecdureu  performed  iri  the 
aircraft  (I’ropliet  & Boyd,  I962).  Training  in  flight  proccduree  han  been 
found  to  be  Guccccr.fully  accompliched  by  uce  of  a full  fidelity  oinulLator, 
a cold  simulator,  and  a photograph  mock-up  (Dougherty,  Houston,  & Nicklac, 
B95T)*  Aircraft  basic  instrument  and  radio  range  training  iiave  been  taught 
equally  well  with  two  devices  at  different  levels  of  fidelity  (Wilcoxon, 
Davy,  & Webster,  195^)-  Torkelson  (195^)  trained  ROTC  students  and  re- 
ciniits  in  the  nomenclature  and  function  of  an  antiaircraft  weapon  using 
a mock-up,  a cutaway,  and  charts.  No  differences  were  found  among  device 
off ectiveneso  for  the  ROTC  group,  while  the  recruits  showed  equal  per- 
formance when  trained  with  all  devices  except  black-and-white  charts,  for 
whicli  performance  was  low.  When  Air  Force  mechanics  were  being  retrained 
on  B-47  fuel,  hydraulics,  or  rudder  power  control  systems,  several  types 
of  training  devices  were  compared  (Swanson,  195^)*  I'he  level  of  functional 
fidelity  was  not  a concern,  but  it  logically  did  vary.  Tlie  following  types 
of  devices  v;ere  compaxed;  an  operating  mock-up,  a nonoperating  mock-up,  a 
cutaway,  an  animated  panel,  charts,  and  symbolic  diagrams.  No  differences 
were  found  in  proficiency  by  training  device,  and  there  were  still  no  dif- 
ferences in  proficiency  by  device,  six  to  eight  weeks  later. 

The  evidence  presented  above,  both  from  the  present  studies  as  w'ell 
as  from  other  research,  forms  a rather  firm  conclusion.  When  men  are  being 
trained  to  perform  a procedure,  ard  a training  device  is  to  be  used  as  a 
method  of  training  tljom,  the  requirements  for  functional  fidelity  in  the 

j device  are  quite  low. 

[■ 
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li.  iipitr  of  tlic  factr.  prcccntcd  above,  tlK?rc  arc  lin'd tationc  on  thc’ 
ooncLuclon.  Tlr  conclurdon  ic  iiiidtcd  to  procedural  tacks.  No  evidence  is 
pi'ecentcd  which  sliould  cncom’at'e  generalization  to  pcyc}iomotor  tasks, 
.iocicion  malting  tasks,  or  aj'.y  work  cLacsil'i cation  other  than  proced’ures. 

The  reader  should  also  recognize  tliat  the  whole  training  process  melds 
to  produce  the  proi'iciency  of  ti'aineec.  Tlie  training  device  did  not 
train  these  men  by  itself.  Tlie  orientation,  the  tecluiiq-ues  of  instruc- 
tors, and  the  psychological  atmosplierc  of  tlie  situation  all  affected 
trainees  and  their  acquisition  of  pi’oficiency  at  the  tack.  In  each  of 
the  studies,  some  variations  occurred  in  using  verbal  signals  to  replace 
visual  and  auditory  signals.  In  the  present  studies,  these  variations 
produced  no  cignificai\t  differences  in  perfonnance.  But  changes  in  the 
training  environment  in  which  the  training  device  is  used  may  be  such  that 
differences  in  the  effectiveness  of  devices  would  occur  at  different  levels 
of  functional  fidelity. 

Witliin  the  above  limitations,  there  is  still  a powerful  implication 
emicrging  from,  the  conclusion.  The  cost  of  equipment  for  training  must  be 
large  when  tactical  equipment  is  the  training  device.  For  example,  cost 
of  the  SCI  itself  has  been  quoted  by  a training  officer  as  about  $11,000. 

To  use  it  in  a "full  fidelity"  mode,  a power  generator,  a Launcher  Control 
Trailer,  one  launcher,  and  a missile  arc  required.  The  authors  estimate 
tlie  full  fidelity  simulator  (Hot  Panel)  used  in  tliis  research  would  cost 
approximately  $3,000.00  each,  liic  cold  paaiel  and  frozen  panel  cost  esti- 
i:.ate  in  high  fidelity  housing  is  $1,000.00  each.  The  photograpli  panel  and 
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housing  cot'l  c:'tii’;atc  is  $100.  'nir  ib'awing  panel  ami  lioucing  coct  cnti- 
rate  .i  e $T;’.  Ii‘  the  cardboard  device  wac  bought  in  quantity,  itc  coct 
\.’ould  be  about  $1.^0  each,  'llius,  for  a procedural  tack,  training  can  be 
jur.t  ac  effective  from  a device  coctijig  $1.50  as  tliat  training  conducted 
v.’ith  a device  costing  more  than  $11,000.  The  designer  of  training  programs 
sliould  be  able  to  select  training  methods,  including  training  devices,  so 
ti'.ai  tlie  program  uses  less  expensive,  low  functional  fidelity  training  de- 
vices for  procedures  training  and  more  expensive  higher  functional  fidelity 
devices  for  training  on  tasks  other  than  procedures,  with  a very  substantial 
monetary  saving. 

Appearance  fidelity. 

Housing  fidelity  was  studied  as  a dimension  within  the  category 
of  appearance  fidelity.  The  housing  was  not  operated  upon  by  the  job 
incumbent  while  he  was  performing  the  task  used  in  this  research.  Tiius, 
veiying  the  housing  did  not  affect  the  functional  fidelity  of  the  device 
but  did  affect  the  appearance  fidelity. 

The  question  to  which  the  housing  study  was  addressed  was,  "What 
is  the  effect  on  development  of  task  proficiency  when  the  housing  of  the 
device  is  degraded  in  appearance?"  When  the  housing  of  the  device  was 
varied  at  three  categorical  levels,  and  men  were  trained  with  the  three 
variations,  no  differences  in  proficiency  were  found  which  were  due  to 
housings.  In  addition,  there  was  no  difference  in  the  amount  of  time  used 
in  training  men  with  each  housing.  In  Study  IV  a confirmation  of  this  re- 
sult was  obtained  with  a cardboard  housing.  The  field  study  also  confirmed 
the  above  findings. 
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A:’.  aiii'A.M'  t.)  the  above  quer.tion  iiat:  been  c-iveii  by  requite:  in  tliin 
rc'jxji'i.  Unbi  r tlu  li id tatlonn  jinponeJ  by  tlic  tank  ctucUe  d here,  tlierc 
in  no  eri'i-ot  on  tlu'  level  of  pi'oficieney  development  v/)ij  e}i  in  related  to 
appcai'auce  fidi'lity  on  the  houning  dime  union. 

The'  iiupli ration  is  that  the  lowtst  oost  housing  available  should  be 
used  v;hieh  will  adequately  suppoi't  and  protect  the  man-maclune  jriterl'ace. 
T’nis  conclusion  is  justified  only  when  the  procedural  task  being  trained 
does  not  require  the  job  incumbent  to  perform  any  operations  on  the  housing. 

In  the  study  of  size  reduction  of  training  devices,  the  appearance 
fidelity  dimension  of  size  was  confounded  with  a training  method  factor. 
When  the  5"  -■<  7"  device  was  used,  the  method  of  training  liad  to  be  changed 
so  that  cacJi  trainee  had  his  own  training  device  to  use  rather  than  all 
five  men  using  a single  training  device.  As  a result,  data  were  collected 
to  estimate  the  effect  of  the  two  training  methods,  and  showed  that  train- 
ing method  had  no  effect  on  proficiency.  Analysis  of  the  data  by  the  ttoee 
size  categories  showed  that  men  can  be  trained  with  a small  device  as  ef- 
fectively as  they  can  with  a full  sized  device. 

This  size  study  extends  the  implications  of  tlie  other  four  studies. 

It  now'  appears  that  when  a training  device  is  to  be  used  to  train  small 
groups  of  men  to  perform  a procedural  task,  small  pictures  or  ih'awings 
can  be  used  as  the  training  device,  each  trainee  having  his  own  device 
on  which  to  stui]y  and  perform.  Tlic  limitation  on  size  reduction  seems 
to  b(.  ordy  tliat  the  trainee  must  be  able  to  visually  identify  the  elements 
on  tlif'  device  and  to  read  any  lettering. 
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Inr.ti'iu’Lor  v.'oi’k  loaii. 


llu'  ri'cu  ardi  iiiatrui’torn  obcn-vcd  t]iat  tlu'  woi’k  Load  placed  on  tiioin  Ly 
all  the  drvicac  vdiich  v.’oi'c  rcaluccd  in  fidelity  \.'a::  ci't liter  than  the  \/ork 
load  required  v.’hen  ur.ing  the  hot  panel  becaune  the  innti’uctoi’,  ratlicr  tiiar. 
the  device,  had  to  provide  cignaJ-s.  The  hot  panel  required  tlic  least  v;ork 
froR'.  an  instructor  because  tlie  jjancl  itself  presented  many  signals  to  the 
ti’ainee  aiid  gave  him  knowledge  of  I'csults  dii’ectLy.  Foi’  example,  tlic-  hot 
panel  made  a noise  like  the  motor  of  a launches'  when  the  Laiuiclier  Eleva- 
tioii  switch  was  placed  in  UP  position.  Tliis  noise  was  both  a signal  to 
tlie  trainee  anei  knowledge  tliat  the  previous  action,  positioning  the  switch 
to  UP,  was  correct.  None  of  the  other  panels  gave  these  signals  to  tlie 
trainee,  and  so  the  instructor  was  required  to  give  tliem  verbally.  Tils 
requirement  meant  that  the  instructor's  attention  was  focused  directly 
on  the  immediate  training  process  duilng  every  mon.cnt  of  training  when 
a panel  other  than  the  hot  one  v/as  being  used.  The  instructor  was  con- 
tinually giving  the  trainee  verbal  signals. 

When  a three-dimensional  pariel  war  being  used,  the  instinictor  told 
the  trainee  to  manipulate  the  switches  just  as  if  the  panel  v.'as  functional 
(or  to  try  to  operate  them  foi’  the  fronen  psuiol).  Tlie  trainees  then  tended 
to  "go  through  the  motions"  without  further  instruction.  Tliis  allowed  the 
instructor  to  observe  the  trainee's  actions  readily  and  to  correct  him  if 
necessary.  However,  when  a two-dimensional  panel  was  used,  trainees  had 
to  be  reminded  several  times  to  "go  tlirough  the  motions"  by  putting  a 
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I'ingrr  on  the  panel  part  v/Mch  vac  being  operated.  Even  win n tin  trainee 
did  thin,  the  instructor  liad  to  observe  more  closely  tlian  before  and  }iad  to 
I'cly  on  verbal  substitutions  from  the  trainee  for  actions  the;  trainee  should 
be  taking. 

niis  added  work  load  did  not  effect  the  time  required  to  train  or  the 
proficiency  level  developed.  Research  instructors  were  able  to  absorb  the 
added  v.’ork  without  an  effect  on  the  training  output.  Tlic  field  study  data 
showed  that  rcilitai’y  instructors  were  able  to  perform  as  well  under  higli 
fidelity  circumstances  as  \mdor  low  fidelity  conditions,  even  though  defi- 
nite lack  of  confidence  in  the  low  fidelity  device  was  expressed  by  come 
instructors. 

! 
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APPENDIX  A 


Proficiency  Test 


Stajutard  Blui-  Stat'.ur  Pi'uci'diircr; 


0;  < i-atoi’  iv-  bi  i'uro  the  SCI  v/hJ  ch  ic  oi-ion  but  "culd."  He-  if; 

.'id  toi-.i  uc  I'ur  Blue  Statuu  Ixeht  and  Alarm  buz/.or  to  cound. 

SIGi'iAL  ACTION 


B’uz'xer  and  Blue  Statue  light.  1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 

11. 

12. 

13. 


Throv/  Power  sv/itch  to  ON. 

Throw  Panel  Light  switch  to  ON 
Put  liand  under  Panel  Light  to  check 
for  illiuidnation  level. 

Adjust  light  level  with  control 
knob . 

Tlirow  all  4 Intercom  switches  to  ON. 
Throw  all  4 Launcher  Power  switches 
to  ON. 

Plug  IIH  (Handset-Headset)  sot  into 
station  2. 

Announce  over  liH  set  "Blue  Status 
received,  Scctien  A." 

Put  Intercom  switch  to  TALK  and  hold. 
Announce  on  IC  (Intercom)  "Blue 
Status . " 

Check  and  adjust  mike  level  while 
announcing. 

Release  IC  switch  to  LISTEN. 

Press  Alann  shut-off  button  till 
buzzer  stops. 
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I 


i4. 


j 


I 

! 

i 

I 


"A.LL  ci-i  wr.n.n  prc  [U'nt"  on  lO.  15. 

lu. 

"I5attLp  Scationc"  on  HU  cet.  If. 

18. 

19. 

20. 


4.  Green  ON  DECK  light.  21. 

5.  "Launcher  #1  prepared,"  on  22. 

ic.  23. 

( . #1  green  PI-tEPAKED  and  SAME  24. 

light  on. 

"Launcher  jf2.  prepared,"  on  25. 

IC.  26. 

. #2  green  PKEPAPED  and  SAIIE  27- 

light  on. 


j.  "Launcher  //3  prepared"  on  1C.  28. 


Monitor  for  "All  ere  omen  precent  ," 
on  KL 

Announce  "All  crc'\.'iiien  1 recent, 
Section  A"  on  iill  cot. 

Monitor  for  "Battle  Stationc,"  on 
IIII  net. 

Announce  "Battle  Stationc  received, 
Section  A, " on  HK  set . 

Operate  IC  sv;itcli. 

Monitor  for  green  ON  DECK  light. 
Aiinounce  "Battle  Stations,"  on  IC. 
Monitor  for  "Launcher  prepared," 
on  IC. 

Press  PREPARED  button  for  #1. 
Monitor  for  green  #1  PREPARED  and 
SA^^E  light. 

Monitor  for  "Launcher  prepared, " 
on  IC. 

Press  PREPARED  button  for  #2. 

% 

Monitor  for  green  §2  PREPARED  and 
SAME  light. 

Monitor  for  "Launcher  prepared, " 
on  IC. 

Press  PREPARED  button  for  ifi. 


52 


2>,'.  Mon;!  ti.)!'  J'oi'  ('ii  //j  r’IJ'irA] J-;J)  and 
m-T.  IJciit. 

I.V  . Gi-i'i'ii  riM’Aia-;])  aiii.1  2AI’3';  liiiht  30.  Monil-ui-  i’or  "Lauiiclior  ^a-r  pared , " 
on  ,v:j.  on  IC. 

' . "riautiohoi-  ifk  projared"  on  1C.  jl.  Pi'ccc  PREI'AKKD  bul-ion  I’oi'  //4. 

32.  Monitoi'  Tor  Hh  t;:rccji  PI\F.PARE1)  aiul 
SAI.IE  Light. 

Li . fih  green  PlLEPAlffiD  and  SAiE 
Liglit  on. 

33*  Monitor  for  "Laiaichor  ready"  on  IC. 

I’,  "haunclior  ifl  rcacly"  on  IC. 

34.  Operate  IC  nwitch. 

35"  Announce  "Stand  clear,  lauiicher  §1 
going  up,"  on  IC. 

36.  Throw  LE  (Launcher  Elevation)  cwitch 
for  #1  to  UP. 

14.  Noi oe  on  IC.  37-  Monitor  noise  on  IC  till  it  stops. 

38.  Throv?  LE  switcli  for  jfl  to  OFF. 

39*  Monitor  for  "Launcher  ready,"  on  IC. 
l;  . "Launcher  jj^  ready"  on  IC.  4o.  Operate  IC  switch. 

kl.  Announce  "Stand  clear,  launcher  ^ 
going  up,"  on  1C. 

42.  Tlirow  LE  switch  for  i^2  to  UP. 

L'  . Ifoise  on  IC.  43.  Monitor  noise  on  IC  till  it  stops. 

44.  Tlirow  LE  switch  for  #2  to  OFF. 


53 


'Launclur  //j  ready"  on  1C. 


k'j.  Monitor  Tor  "Launchci’  ready"  on  IC. 

46.  Operate  1C  .'-.witch 

k'( . Announce  "Stand  clear,  launcliei-  //3 


i 

1 


Koioe  on  1C. 

"Launcher  'fl=h  ready"  on  IC. 


i-’O.  Noise  on  IC. 

21.  Section  Chief  comes  into 
revetment . 

^ 22.  Section  Chief  turns  safety 
keys  to  FIRE. 

23.  All  four  LAUNCHER  READY 
lights  on. 


going  up,"  on  IC. 

48.  'i'lirow  LE  switcli  for  ^3  to  UP. 

49.  Monitor  noise  on  IC  till  it  stops. 

50.  Throw  LE  switch  for  ^3  to  OIT. 

51.  Monitor  for  "Launclicr  ready"  on  IC. 

52.  Operate  IC  switch. 

53*  Announce  "Stand  clear,  launcher  fh 
going  up,"  on  IC. 

54.  Throw  LE  switch  for  #4  to  UP. 

55-  Monitor  noise  on  IC  till  it  stops. 

56.  TJirow  LE  switch  for  #4  to  OFF. 

57*  Wait  for  Section  Chief. 

58.  Throw  all  4 IC  switches  to  OFF. 

59*  Monitor  for  4 amber  LAUNCHER 
READY  lights. 

60.  Throw  H&G  (Heaters  & Gyros)  switch 
for  #1  to  ON. 

61.  Record  time  on  log. 

62.  Monitor  for  green  READY  TO  FIRE 
liglit  for  #1. 


5^ 


2h.  Givc'ii  IvFADY  TO  1x^1  it 


TOi'ii  DEGIGKATE  :;witch  to  //l  otrip. 


25.  Green  IjAUNCliEl^  DESIGNATE 

light  on. 

2i'.  Siiiootli  movement  of  needle  ilill 

left  to  full  right  twice. 

27.  SECTION  KEADY  green  light  on. 

23.  Section  Chief  sayc,  "Blue 

Status  checks  complete." 


OJ. 


(A.  IT'ess  LAUNCJIFJ1  DESIGm'TE  button. 

6^;.  Monitor  for  green  LAUNCHED  DESIGIATE 
liglit. 


66.  Press  SLEW  button  & liolcl  tljroug}i 
chock . 

67.  Tlirow  SECTION  HEADY  switch  to  READY. 

68.  Check  for  green  SECTION  HEAliY  light. 

69.  Wait  for  Section  Cliief  to  OK. 


70.  Announce  "Blue  Status  checks 

complete,  Section  A,"  on  HH  set. 
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'iVo  Ma  ocilcu 

cprratoi’  ir.  r.taiuliiu'  in  front  of  open 
on.  Cliccks  arc  complete.  Operator  i 
fi.)!'  Kfd  Status. 

SIGNAL 

1 . Red  Status  light  on. 

2.  Green  SETjECTED  light  on. 


3.  Buzzer,  green  FIRE,  LAUNCH 
ORDER,  and  MISSILE  AWAY 
lights  on. 


Blue  Status  i .s 
et  and  is  monitoring 

ACTION 

1.  Monitor  for  Red  Status  light. 

2.  Announce  over  HH  set,  "Red  Status 
received.  Section  A." 

3.  Monitor  for  green  SELECTED  light. 

4.  Tlirow  H&G  switch  for  ^ to  ON. 

5.  Log  starting  time. 

6.  Monitor  for  buzzer  and  green  FIRE, 
LAUNCH  ORDER,  and  MISSILE  AWAY 
liglits. 

7.  Throw  SECTION  READY  switch  down 
(OFF). 

8.  nirow  LAUNCHER  ELEVATION  switch 
for  #1  to  DOWN. 

9.  ibnitor  for  green  READY  TO  FIRE 
liglit  on  #2. 

10.  Move  LAUNCHER  ELEVATION  switch  for 
§1  to  OF!’. 


Landai'd  Rcu  Suatus  Pi'oceduiv  s to  Fii'e 
in  Automatic  Mode 

SCI.  Powi'i-  is  on. 

V/ earing  HH 


I 


k.  Grrcti  IffiAIXiT  TO  FIl®  licht 
Tor  !!2  o’.i. 

Grt'eti  MirNClCEH  nESIGNA'TE 

j light  on. 

i 

i 

t 

! 0 . Smooth  movement  of  needle 

I 

i 

I left  to  0,  right  to  0,  twice. 

1 T.  Green  SECTION  ItEADf  rigJit  on. 

J 

j Green  SEIiECTED  light  on. 


9.  Buzzer  and  green  FIItE,  LAUNCH 

ORUEB,  and  MISSILE  AWAY  liglitc 
on. 


11.  Move  IRSIGIiATE  nwitch  to  //2  ntrip. 

12.  Preco  LAUl'JCHER  DESIGNATE  button. 

13.  Monitor  for  green  LAUNCIIH^  DESIGNAT’E 
liglit. 

i 

14.  Press  SLEW  button. 

15.  Monitor  SLEW  METER  for  correct  c})eck. 

16.  Throw  SECTION  ld£ADY  switch  up  (ON) . 

17.  Monitor  for  green  SECTION  READY  light. 

! 

iR.  Monitor  for  green  SELECTED  light.  j 

19.  'Tlirow  II&G  switch  for  -jfS  to  On. 

20.  Log  starting  time.  | 

I 

21.  Monitor  for  buzzer  and  green  FIRE, 

LAUNCH  ORDER,  and  MISSILE  AWAY 
lights. 

I 

22.  Thr  w SECTION  READY  switch  down  (OFF).  ; 

1 

I 
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APPENDIX  B 


Orientation  to  the  Nike  Hercules  Site  and 


Tlie  Section  Control  Indicator  (SCl) 


ojajliJmTioN  TO  Tin:  nike  iiekcujj-:s  cue 

ANU  T1Q-:  SECTION  CONTROL  INDICATOR 

'llie  Nike  Hercules  is  primarily  an  antia::  rcral't  missile  and  can 
ee  aniiel  with  a nuclear  warhead,  'ilie  site  consists  ol  appj-oximately 
ciodit  major  pieces  ol'  equipment.  The  layout  varies  frcim  site  t*.;  site 
depending  on  geographic  conditions  and  hei’e  you  see  one  example  of  a 
basic  site  layout  on  this  chart.  Tills  could  represent  an  area  of 
sevei-al  miles  and  the  only  consistency  is  the  separation  of  the  IFC 
(integi'ated  Fire  Control)  area  (the  upper  half  of  the  diagi-am)  from 
the  launching  area. 

Acjuisltion  Radar  (AR) 

Tlie  acquisition  radar  operates  continually  as  it  searches  the 
area  of  protection.  Wlien  a target  has  been  acquired,  the  acquisition 
radar  sends  azimuth  and  range  data  to  the  Target  Tracking  Radar  througli 
the  computer. 

Target  Tracking  Radar  (TTR) 

Tne  TTR  locks  on  the  target  and  tracks  it  until  the  target  is 
either  released  by  the  Battery  Control  Officer  (BCO)  or  destroyed  by 
the  selected  missile.  The  tracking  data  is  fed  to  the  computer  to 
enable  it  to  plot  the  missile  course  to  the  intercept  point. 
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Miasale  Tracking;  Itedar  (MTK) 

Wio;i  the  iiiiGeile  ic  rired  the  MTh  contx’uls  the  rii^^ht  pattei-n  and 
scndc  missile  position  data  to  tlic  computei-. 

liic  three  radars  liave  opei’atoi's  eonstantiy  monitoring  tlie  display 
scopes . 


Isatteiy  Control  Officer  (BOO) 

'flie  comp)uter  infoimation  is  monitored  by  t’ne  BOO  and  makes  the  final 
decision  wliether  a missile  should  be  launched. 

Launcher  Control  Officer  (LCO) 

Tlie  LCO  relays  the  commands  from  the  BCO  to  the  Section  Control  Indica- 
tor (SCl)  operators.  Tlie  LCO  controls  twelve  missiles  tlxrough  three  SCI 
panels  and  it  is  liis  responsibility  to  sele ct  a ndssile  for  firing. 

Section  Control  Indicator  (SCI) 

Tlae  operator  of  the  SCI  coordinates  his  duties  with  his  Section  Chief 
and  the  LCO.  He  checks  the  SCI  daily  and  maintains  communication  between 
the  LCO  and  the  launcher  crew.  The  SCI  supplies  the  power  to  the  four 
missiles  on  the  launchers.  Tlie  SCI  operator  is  responsible  for  the  crewmen 
and  the  status  of  the  missile  during  this  procedure. 

You  are  here  to  learn  the  SCI  procedures  in  Blue  Status  and  Red  Status. 
Blue  Status  is  the  procedure  taken  to  prepare  a missile  for  firing,  and 
Red  Status  is  the  actual  firing  procedure. 

Do  you  have  any  questions? 
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Table  C-I 


Distribution  of  GT  Goortc  for 
6^  Men  in  MOS  177 
and  for  15  and  20  Case  Samples 

Study  I 


Actual  Distri- 
bution of 

MOS  177 

Range  of 

GT 

Scores 

Frequency 
per  Panel 
Sample 
(II  = 15) 

Frequency 
per  Panel 
Sample 

(k  20) 

6 

80  and  belovr 

— 

1 

2 

18 

81  - 90 

5 

6 

11 

91  - 100 

3 

3 

10 

101  - 110 

2 

•I 

J 

10 

111  - 120 

2 

3 

5 

121  - 130 

1 

C.  j 

5 

131  and  above 

1 

1 

z = 65 

— — ..  . 

z = 15 

Z = 20 

I 

I 

1 
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Table  C-2 


scion  ~ Instructoi' 


f 


Table  C-S 

Distribution  of  Proficiency  Scores 


for  Each  Traininc  Group 

(N  = 20/Group) 
Study  I 


Hot  Panel 

Cold  Panel 

Frozen  Panel 

92 

92 

92 

92 

92 

92 

92 

91 

91 

92 

91 

91 

91 

91 

89 

91 

90 

89 

91 

89 

88 

91 

89 

87 

91 

89 

86 

90 

88 

84 

89 

88 

83 

89 

86 

83 

88 

85 

83 

88 

85 

83 

88 

84 

82 

8t 

84 

81 

86 

81 

74 

70 

79 

69 

60 

74 

68 

57 

70 

54 

Mean  = 85.8 

Mean  =85.9 

Mean  =82.4 

Median  =89.5 

Median  = 88.0 

Median  =83.5 

r 

[ 

I 


Tatle  C-7 

Proficiency  Score  Means  for 
Instructors  and  Panels 
Study  I 


Instructor 

Hot  Panel 

Cold  Panel 

Frozen  Panel 

Total 

1 

86.4 

82.4 

85.8 

84.9 

2 

83.6 

88.0 

76.8 

82.8 

3 

86.5 

86.6 

83.6 

85.6 

Total  85.8  85.9  82.4  84.7 


Tatlo 


I .'djiiatc-d  I’roficicncy  Score  Means  and  Correlation  Coerflcients 

I'or  Instructors  and  Panels 

I Study  I 


1 

Instructor 

Hot  Panel 

Cold  Panel 

Frozen  Panel 

Total 

r 

1 

1 

86.0 

82.9 

89.9 

84.9 

.451 

! 

2 

83.9 

87.2 

78.6 

83.2 

.478 

i 

\ 

1 

3 

86.1 

86.2 

83.9 

85.4 

.498 

* Total 

89. 

83.6 

82.9 

84.7 

r 

M2 

.48.8 

.521 

.479 

Ta'Dle  C-9 


/uialysis  ol'  Variance  of  Ti-ainiiig  Times: 
Panels  and  Instructor  Groups 
Study  I 


oource  of 
Variance 

if 

Sums  of 
Squares 

Mean 

Square 

— 

F 

2 

704. l6o 

352.070 

1.207^ 

2 

129.160 

64.5^30 

< 1 

P X I 

4 

1166.680 

291.670 

Total  8^  2000.000 

""p  > .05 


Cne  instructor  trained  two  five -man  groups  per  panel.  This 
instructor's  two  training  time  scores  for  each  panel  were  averaged. 
Tliese  means  were  used  as  the  entries  for  the  appropriate  cells  in  the 
ahove  analysis. 
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Table  C-10 

Training  Time  Means®  for  Panels 

and  Instructor  Groups 
Study  I 


Instructor 

Mean 

Panel 

Mean 

1 

156.7 

Hot  Panel 

15^^.  2 

2 

160.0 

Cold  Panel 

155.0 

3 

165.7 

Frozen  Panel 

173.3 

Total 

160.8 

Total 

160.8 

Srn 

Time  is  chovm  in  niinatcs. 


Tatle  C-11 


Test  of  Homogeneity  of  Regression:  Cells 
Study  II 


Soiirce  of  Variance 

Errors  of 

Estimate 

dl' 

SS 

MS 

Deviation  from  average  regression 
within  cells 

07 

3760.771 

Deviation  from  individual  cell 
regressions 

56 

3535.716 

63.137 

Differences  among  cell 
regressions 

11 

225.055 

20.459 

F < l.CO 
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Tatle  C-12 


Test  of  Homogeneity  of  Regression:  Panels 
Study  II 


Source  of  Variance 

Errors  of 

Estimate 

df 

SS 

MS 

Deviations  from  average  regression 
within  panels 

75 

3793.864 

Deviations  from  individual  panel 
regressions 

72 

3520.682 

48.898 

Difference  among  panel 
regressions 

3 

273.182 

91.060 

Tatle  C-13 


Test  of  Homogeneity  of  Regression:  Instructors 

Study  II 


Soiirce  of  Variance 

Errors  of  Estimate 

df 

SS 

MS 

Deviations  from  average  regression 
vriLthin  instructors 

76 

387^4-.  674 

Deviations  from  individual 
instructor  regressions 

Jk 

3738.597 

50.521 

Differences  among  instructor 
regressions 

2 

136.077 

68.038 

F = 1.3^6,  p > .20’ 
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TalDle  C-15 


Distribution  of  Proficiency  Scores 
for  Each  Training  Group 
(N  = 20/Group) 

: study  II 


Hot  Panel 

Frozen  Panel 

Photograph  Panel 

Drawing  Panel 

92 

92 

90 

91 

92 

92 

90 

91 

92 

91 

90 

91 

92 

91 

89 

90 

91 

89 

88 

89 

91 

89 

88 

88 

91 

87 

87 

91 

87 

86 

87 

91 

86- 

86 

87 

90 

84 

86 

86 

89 

83 

84 

86 

89 

83 

83 

85 

88 

83 

82 

85 

88 

83 

80 

81 

88 

82 

80 

77 

87 

81 

79 

76 

86 

74 

79 

74 

70 

69 

78 

70 

Go 

68 

77 

67 

57 

54 

72 

53 

iieara  = 85-75 

Mean  = 82.45 

Mean  = 83-70 

Mean  = 82.05 

Median  = 89.5 

Median  =83.5 

Median  =84-5 

Median  = 86.0 

i 
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Table  C-I7 

AdjuDted  Prof  j ciency  Score  Means  for  Insti-uctors  and  Panels 

Study  II 


Instructors 

Hot 

Frozen 

Photo 

Dravd.ng 

Total 

1 

86.01 

85.59 

81.25 

80.19 

83.08 

2 

83.39 

75.36 

84.06 

77.88 

80.63 

3 

87.05 

83.80 

84.68 

84.65 

85.05 

Total 

85.68 

82.31 

83.68 

81.79 

83.50 

TaTjlc  C-lo 


.'Vnalysis  of  Variance  of  Ti-airiiiifr  Times: 
Panels  and  Inctr'actors  Groups 

Study  11 


Soiu-ce  of 

Variance 

dl' 

Sirnis  of 
Squares 

Mean 

Square 

P 

Panels 

3 

93^i.89 

311.63 

< 1 

Instructor  Groups 

2 

303.13 

151.56 

< 1 

P X I 

6 

3326.03 

55'+.  3*^ 

Total 

ll" 

U564.OY 

^One  instructor  trained  two  five-man  groups  per  panel.  This 
instructor's  training  time  scores  for  each  panel  were  averaged, 
lliese  means  were  used  as  the  entries  for  the  appropriate  cells  in 
the  analysis. 
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Tatle  C-19 

Traiuinc  Time  Means  foi’  Panels  and  Instructor  Groups 

Study  II 


Instructor 

Panels 

Mean 

Hot 

Frozen 

Hioto 

Drawing 

1 

2.67 

2.67 

3.2^, 

2.58 

2.79 

2 

2.75 

2.75 

2.75 

3.90 

2.9V 

3 

2.29 

3.25 

2.79 

2.38 

2.68 

Mean 

2.57 

2.89 

ro 

C\ 

CJ 

2.82 

2.80 

Tal.le  C-PO 


Distril^ution  of  Proficiency  Scores 

for  Each  Training  Group 
(N  = 15/Group) 

Study  111 


High  Fidelity 
Housing 

Box 

Housing 

Frojjie 

Housing 

91 

91 

92 

89 

91 

90 

89 

91 

89 

88 

90 

88 

87 

89 

88 

85 

88 

86 

85 

88 

84 

84 

88 

83 

83 

86 

82 

79 

86 

81 

79 

77 

80 

77 

75 

80 

72 

74 

79 

72 

73 

79 

89 

70 

77 

Mean  =81.9 

Median  = 84 

Mean  = 83.8 

Median  = 88 

Mean  = 83*8 

Median  = 83 

Table  C-21 


Test  of  Homogeneity  of  Regression  - Cells 
Ctudy  III 


Source  of  Variance 

Errors  of 

Estimate 

df 

SS 

MS 

Deviation  from  average  regression 
within  cells 

35 

1301.190 

Deviation  from  individual  cell 
regressions 

27 

451. 014 

16.704 

Differences  among  cell 
regressions 

8 

850.176 

106.272 

F = 6.362,  p < .001 


Table  C-22 


r 


Test  of  Homogeneity  of  Regression  - Housings 
Study  III 


Source  of  Variance 

Errors  of 

' Estimate 

df 

SS 

MS 

Deviations  from  average  regression 
vd-thin  housings 

h2 

1289.770 

Deviations  from  individual 
housing  regressions 

4o 

1270.902 

31.922 

Differences  among  housing 
regressions 

2 

12.868 

6.434 

F < 1.00 
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TaTale  C-24 


Means,  Correlation  Coefficients  and 

Eegressiou  Coefficients 
Study  III 


Housing 

Mean 

GT 

Mean 

Proficiency 

Mean  Adilusted 
Proficiency 

Correlation 

Coefficient 

Eegression 

Coefficient 

High  Fidelity 

99.53 

81.93 

82.06 

.50 

.195 

Box 

100.60 

83.80 

83.73 

.55 

.208 

Frame 

100.53 

83.87 

83.81 

.56 

.1^3 

Totca 

100.22 

83.20 

83.20 

.53 

.^85 

89 


Table  C-2'^  I 

Analysis  of  Variance  ol'  Training  Time  | 


Housings 
Gtudy  III 


Source  of 

Variance 

df 

1 

ss 

MS 

F 

P 

Housings 

2 

.118 

.056 

1.018 

> .10 

Instructors 

2 

.078 

.039 

< 1.00 

Housings  X Instructors 

b 

.220 

.055 

Total 

8 

.4l6 

Table  C-26 

U 

Table  of  Mean  Training  Times' 
Housings 

Study  III 


Time  is  shovm  in  hours. 
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Instructor 

High  Fidelity 

Box 

Frame 

Mean 

1 

3.00 

2.83 

b 

0 

2.94 

2 

2.83 

2.83 

3-00 

2.89 

3 

3.17 

2.50 

2.50 

0 •7'^ 
e-*  fc. 

Mean 

3.00 

2.72 

2.83 

2.85 

J 


Ta^ble  C-2Y 

Test  of  Homogeneity  of  Hegi'ession  - Cells 
Study  IV 


Source  of  Variance 

Eri’ors  of 

Estimate 

i 

df 

ss 

MS 

1 

Deviation  from  average  regression 
within  cells 

37 

3063.683 

Deviation  from  individual  cell 
regressions 

29 

2304.388 

49.461 

! Differences  among  cell 
j regressions 

8 



759.295 

94.911 

F --  1.194 

p > .20 
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1 

i 


Table  C-2H 


i 


Test  of  Homogeneity  of  Regression  - I’anels 
Study  IV 


Table  C-29 


Test  of  Homogeneity  of  Regression  - Instructors 
Study  IV 


Source  of  Variance 

Errors  of 

Estimate 

df 

SS 

MS 

Deviations  from  average  regression 
v;ithin  instructors 

42 

3435.839 

Deviations  from  individual 
instiaictor  regressions 

4o 

3378.090 

8ii  .451 

Differences  among  instructor 
regressions 

2 

57. 7*^9 

28.874 

F < 1.00 


93 


Table  C-jO 

Distribution  of  Proficiency  Ccore 

for  Each  Traininc  Grouxi 
(N  = 15/Group) 

Stud;.'  IV 


Cardboard  Panel 


Hot  Panel 


Cold  Panel 


Mean  = 85.6 
Median  =89*5 


Mean  = 8I.8 


Mean  = 8I.7 
Median  =87.5 


Median  =85.5 


Table  C-jl 


Means  - ProTi  f'i.pncy  Gcoroc 
Study  IV 


Instructor 

Hot 

mm 

Cardboard 

Total 

1 

83.6 

88.0 

78.6 

83.4 

2 

82.6 

86.8 

80.8 

83.4 

3 

79.1 

82.0 

86.0 

82.3 

Total 

81.7 

85.6 

81.8 

83.0 

Table  C-3<- 


Adjusted  Means  - Prol'icieiicy  Scores 
Study  IV 


Instructor 

Hot 

Cold 

Cardboard 

Total 

1 

82.5 

87.8 

79.3 

83.2 

2 

82.4 

86.3 

80.7 

83.2 

3 

79.8 

82.4 

86.0 

82.5 

Total 

81.5 

85.5 

81.0 

83.0 
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Tal-lc  C-^4 

Analysis  af  Variance  oi'  Traiulnf^  Time 
Hot,  Cold,  and  CardLoard  I’ancls 

I'Andy  IV 


Source  of 
Variance 

df 

■ 

MS 

F 

Panels 

■ 

ooo 

• C.(— 

• 111 

< 1.00 

Instructors 

.722 

.3^1 

1.76 

> .20 

P X I 

1 

.820 

.205 

Total 

8 

1.76^ 

,,  , - 1 

Tatle  C-35 

Table  of  Mean  Training  Tinies'’ 
Hot,  Cold,  and  Cardboard  Panels 

Study  IV 


Instructor 

Hot 

Cold 

Cardboard 

Mean 

1 

2.75 

2.50 

3.75 

3.00 

2 

2.25 

2.75 

2.50 

ro 

0 

3 

2.50 

2.50 

2.25 

2.33 

Mean 

2.50 

2.50 

2.83 

2.61 

am.. 


Time  is  shown  in  hours. 
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Talile  C-30 

Proficiency  Score  Distributions  and  Distiltutiun  Statistics 

Stud;,'  V 


Full  Size 

Half  Size 

Huli'  Size 

Sniall  Size 

Method  I 

Method  I 

Method  II 

Method  II 

91 

90 

91 

90 

89 

90 

91 

39 

87 

90 

89 

89 

87 

89 

88 

88 

87 

89 

87 

87 

86 

87 

87 

86 

86 

86 

85 

84 

84 

86 

83 

84 

84 

84 

83 

82 

81 

84 

83 

80 

79 

84 

81 

80 

78 

83 

78 

79 

75 

83 

78 

79 

72 

79 

76 

70 

63 

73 

76 

70 

M = 81.9 

85.1 

83.7 

82.4 

Md  = 84.0 

83.0 

84.0 

S.D.  = 7.5 

5.1 

5.5 

6.9 

J 


Table  C-3J 


/uialysis  of  Variance  of  Proficiency  Scores 
Prom  Thiree  Sizes  of  a Training  Ijevlce 

Study  V 
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Research  was  performed  to  determine  the  effects  on  proficiency  development  of 
using  devices  of  less-than-perfect  fidelity  for  training  a lengthy  fixed 
procedure. The  fidelity  of  a training  device  was  the  degree  to  which  It 
resemblcKl  tHt  tactical  equipment  for  which  the  training  device  was  substituted^ 
The  fidelity  of  training  devices  was  lowered  In  either  appearance  or 
functional  quality.  A fixed  procedure  was  a part  of  a job  In  which  all 
signals  to  the  incumbent  and  actions  by  the  Incumbent  were  specified  In  an  
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invariable  sequence. 

Conclusions  reached  are  as  follows:  (1)  when  men  are  being  trained  to 
perform  a fixed  procedure,  the  requirements  for  functional  fidelity  In 
the  training  device  are  quite  low.  A line  drawing  of  the  man-machine 
Interface  will  train  men  as  effectively  In  this  circumstance  as  will  a 
device  of  higher  fidelity;  (2)  no  effect  on  proficiency  development  is 
likely  to  occur  due  to  reducing  housing  fidelity  of  the  man-machine  Inter- 
face on  a training  device.  The  least  expensive  housing  which  will 
adequately  support  and  protect  the  man-machine  interface  should  be  used; 
C3)  Lowering  the  fidelity  of  a training  device  by  reducing  Its  size  has 
no  effect  on  proficiency  development,  so  long  as  the  parts  of  the  device 
remain  clearly  visible  to  the  individual  trainee.^ 
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